{"ygPerms":{"resourceCapabilityList":[{"resourceType":"GROUP","capabilities":[{"name":"UPDATE"},{"name":"READ"},{"name":"WELCOME_MSG"},{"name":"PENDING_COUNT"},{"name":"ACTIVITY_LOGS"}]},{"resourceType":"PHOTO","capabilities":[{"name":"READ"},{"name":"READ"},{"name":"UPLOAD"},{"name":"UPDATE"},{"name":"DELETE"},{"name":"COPY"},{"name":"MOVE"},{"name":"APPROVE"},{"name":"UPLOADTEMP"},{"name":"GROUPCOVER"}]},{"resourceType":"FILE","capabilities":[{"name":"READ"},{"name":"CREATE"},{"name":"UPDATE"},{"name":"DELETE"},{"name":"AUTO_SEND"}]},{"resourceType":"MEMBER","capabilities":[{"name":"READ"},{"name":"READ"},{"name":"EDIT_MODERATOR"},{"name":"DELETE"},{"name":"CREATE"},{"name":"UPDATE"},{"name":"BAN"}]},{"resourceType":"LINK","capabilities":[{"name":"READ"},{"name":"CREATE"},{"name":"UPDATE"},{"name":"DELETE"},{"name":"MOVE_LINK"}]},{"resourceType":"CALENDAR","capabilities":[{"name":"READ"}]},{"resourceType":"DATABASE","capabilities":[{"name":"READ_DATA"},{"name":"CREATE"},{"name":"READ"}]},{"resourceType":"POLL","capabilities":[{"name":"READ"},{"name":"VOTE"},{"name":"UPDATE"},{"name":"CREATE"},{"name":"DELETE"},{"name":"CLOSE"}]},{"resourceType":"MESSAGE","capabilities":[{"name":"CREATE"},{"name":"READ"},{"name":"DELETE"}]},{"resourceType":"PENDING_MESSAGE","capabilities":[{"name":"READ"},{"name":"UPDATE"},{"name":"DELETE"}]},{"resourceType":"ATTACHMENTS","capabilities":[{"name":"READ"},{"name":"DELETE"}]},{"resourceType":"PHOTOMATIC_ALBUMS","capabilities":[{"name":"READ"},{"name":"UPLOAD"}]},{"resourceType":"MEMBERSHIP_TYPE","capabilities":[{"name":"READ"},{"name":"CREATE"},{"name":"DELETE"},{"name":"UPDATE"}]},{"resourceType":"POST","capabilities":[{"name":"DELETE"},{"name":"CREATE"},{"name":"UPDATE"},{"name":"READ"}]},{"resourceType":"PIN","capabilities":[{"name":"DELETE"},{"name":"CREATE"},{"name":"UPDATE"},{"name":"READ"}]}],"modStatus":"MODERATOR","subStatus":"NORMAL","groupUrl":"groups.yahoo.com","intlCode":"us"},"comscore":"pageview_candidate","ygData":{"userId":271945271,"authorName":"Maynard Hogg","from":"&quot;Maynard Hogg&quot; &lt;maynard.hogg@gmail.com&gt;","profile":"maynard_hogg","replyTo":"LIST","senderId":"WSKHuYq_uI57p-BpHZELc-OzhxatqdkbEdnHus92xAr8qltljcLWkecyb83gXPFtjBiggPfCSc4CRRYHeXzopNfyY_0h6_VwFpF77xIc","spamInfo":{"isSpam":false,"reason":"0"},"subject":"Re: [OmT] Re: segmentation in Japanese","postDate":"1151639121","msgId":5406,"canDelete":true,"contentTrasformed":false,"systemMessage":false,"headers":{"messageIdInHeader":"PDc3OGFmOWJjMDYwNjI5MjA0NXkzNDI4ZDhlZ2E1MDM0YWNkOWM3N2U1YzNAbWFpbC5nbWFpbC5jb20+","inReplyToHeader":"PDU0NzgxOTA4MGE1ZDA4NmQxODhjM2FlNWE5NzI5YWNjQGVza2ltby5jb20+","referencesHeader":"PDc3OGFmOWJjMDYwNjI3MTkzNHAxMDI0M2NiYXAyYWZkOWFjZjhhNzQ3Yjc1QG1haWwuZ21haWwuY29tPgkgPDc3OGFmOWJjMDYwNjI3MTk0MW02OTMxMjhjYXcxNWQ2NjZjY2M2OGNlODU3QG1haWwuZ21haWwuY29tPgkgPDU0NzgxOTA4MGE1ZDA4NmQxODhjM2FlNWE5NzI5YWNjQGVza2ltby5jb20+"},"prevInTopic":5405,"nextInTopic":5407,"prevInTime":5405,"nextInTime":5407,"topicId":5359,"numMessagesInTopic":31,"msgSnippet":"... I m all ears. For years at the ATA conferences, the assumption has always been that segments are either full sentences or such fragments as title, table","rawEmail":"Return-Path: &lt;maynard.hogg@gmail.com&gt;\r\nX-Sender: maynard.hogg@gmail.com\r\nX-Apparently-To: OmegaT@yahoogroups.com\r\nReceived: (qmail 53520 invoked from network); 30 Jun 2006 03:46:22 -0000\r\nReceived: from unknown (66.218.66.166)\n  by m35.grp.scd.yahoo.com with QMQP; 30 Jun 2006 03:46:22 -0000\r\nReceived: from unknown (HELO nf-out-0910.google.com) (64.233.182.184)\n  by mta5.grp.scd.yahoo.com with SMTP; 30 Jun 2006 03:46:22 -0000\r\nReceived: by nf-out-0910.google.com with SMTP id c2so166125nfe\n        for &lt;OmegaT@yahoogroups.com&gt;; Thu, 29 Jun 2006 20:45:21 -0700 (PDT)\r\nReceived: by 10.78.139.5 with SMTP id m5mr1481173hud;\n        Thu, 29 Jun 2006 20:45:21 -0700 (PDT)\r\nReceived: by 10.78.123.3 with HTTP; Thu, 29 Jun 2006 20:45:21 -0700 (PDT)\r\nMessage-ID: &lt;778af9bc0606292045y3428d8ega5034acd9c77e5c3@mail.gmail.com&gt;\r\nDate: Fri, 30 Jun 2006 12:45:21 +0900\r\nTo: OmegaT@yahoogroups.com\r\nIn-Reply-To: &lt;547819080a5d086d188c3ae5a9729acc@eskimo.com&gt;\r\nMIME-Version: 1.0\r\nContent-Type: text/plain; charset=ISO-8859-1; format=flowed\r\nContent-Transfer-Encoding: 7bit\r\nContent-Disposition: inline\r\nReferences: &lt;778af9bc0606271934p10243cbap2afd9acf8a747b75@mail.gmail.com&gt;\n\t &lt;778af9bc0606271941m693128caw15d666ccc68ce857@mail.gmail.com&gt;\n\t &lt;547819080a5d086d188c3ae5a9729acc@eskimo.com&gt;\r\nX-Originating-IP: 64.233.182.184\r\nX-eGroups-Msg-Info: 1:0:0:0\r\nFrom: &quot;Maynard Hogg&quot; &lt;maynard.hogg@gmail.com&gt;\r\nSubject: Re: [OmT] Re: segmentation in Japanese\r\nX-Yahoo-Group-Post: member; u=271945271; y=hsXlk9X5ktgmKW8GUC1DAWn5sHLa_yFNARxMwGfVqKdSVABrq5zU\r\nX-Yahoo-Profile: maynard_hogg\r\n\r\nOn 6/29/06, Jean-Christophe Helary &lt;helary@eskimo.com&gt; wrote:\n\n&gt; I am the one who wrote the segmentation rule(s) for Japanese and I\n&gt; found other rules that could be put in the default too for a next\n&gt; release.\n\nI&#39;m all ears. For years at the ATA conferences, the assumption has\nalways been that segments are either full sentences or such fragments\nas title, table cell contents, etc. Only once have I ever heard anyone\nsuggestion expanding to the paragraph level. Then in Kobe, you opened\nmy eyes to the possibilities in using smaller units. At the time, I\ndidn&#39;t know how long the (run-on) &quot;sentences&quot; in Japanese patents\ncould be.\n\n&gt; If you have suggestions please go ahead :)\n\nThis week, I&#39;m concentrating on pre-processing: zenkaku letters and\nnumerals to ASCII, zenkaku symbols to ASCII (or Unicode), hankaku\nkatakana to zenkaku, eliminating carriage returns in the middle of\nJapanese words, etc.\n\n"}}