[jira] [Updated] (ACCUMULO-483) Create purge locality utility

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Updated] (ACCUMULO-483) Create purge locality utility

JIRA jira@apache.org

     [ https://issues.apache.org/jira/browse/ACCUMULO-483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Keith Turner updated ACCUMULO-483:
----------------------------------

    Fix Version/s:     (was: 1.4.1)
                   1.4.2
   

> Create purge locality utility
> -----------------------------
>
>                 Key: ACCUMULO-483
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-483
>             Project: Accumulo
>          Issue Type: New Feature
>          Components: client
>            Reporter: John Vines
>            Priority: Minor
>              Labels: newbie
>             Fix For: 1.4.2
>
>
> For some high capacity ingest, the desired path is to do some pre-splits, bulk import, and then let it naturally split down the rest of the way. If all of the pre-split tablets made split evenly, then the system will have continuous ranges bundled together on tservers. This poor distribution can impact performance depending on the operations performed. This could be handled in the load balancer, but it could be tricky. You don't want to randomly reassign tablets with any sort of frequency. Rather, you want to do a one-time operation in doing so. Given the initial assignment code is a bit random (needs to be validated), this could easily be done by offlining a table, purging all location records for it from the !METADATA table, and bringing it back online. The balancer will assign the table randomly, at which point the user could force a major compaction to restablish locality (as well some permanence in tablet assignment).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       
Loading...