"Jason, Thanks a lot for the comment and link. Looks like my team is willing to give it a shot :)"
A Community for Hadoop Users
Alexander Volkov's Discussions
Enhanced Producer-Consumer problem
2 Replies
Hi all, this is more an architectural question whether ZooKeeper can be used to solve it.Here is the statement of the problem.There is a continuous flow of the data to be processed by several clients…Continue
Started this discussion. Last reply by Alexander Volkov May 17, 2010.
Alexander Volkov's Page
Gifts Received
Alexander Volkov has not received any gifts yet
Latest Activity
Jason Venner replied to Alexander Volkov's discussion Enhanced Producer-Consumer problem"There are a number of articles on using zookeeper as a distributed queue manager:
http://www.cloudera.com/blog/2009/05/building-a-distributed-concurrent-queue-with-apache-zookeeper/
100,000 per day is pretty trivial with zookeeper.
If the…"
Alexander Volkov joined Jason Venner's group
NoSql
A group for discussion various distributed random access datastores that work well with the hadoop ecosystem tools
Alexander Volkov posted a discussionEnhanced Producer-Consumer problem
Hi all, this is more an architectural question whether ZooKeeper can be used to solve it.Here is the statement of the problem.There is a continuous flow of the data to be processed by several clients (consumers) (say there are 100,000 data items per day). All data items can be classified in different categories. Each data item can belong to one category only. The data items in a flow come in a certain order. The requirement is that no data items that belong to same category can be processed…See More
Profile Information
- Hadoop Experience Level
- Novice
- Interests
- Want to learn applications of ZooKeeper
- Expertise
- Java EE applications -- Spring, JPA/Hibernate, Flex/Action Script/BlazeDS, Tomcat, etc
- Past Projects
- Mostly Java enterprise application, back-end
- Current Project
- Java Enterprise application back-end and UI (in Flex)
- Search Expertise
- Novice
- HBase Expertise
- Novice
- Machine Learning Expertise
- Intermediate
Comment Wall
- No comments yet!
Groups
-
NoSql
6 members
-
Karma Sphere Studio Users
4 members
-
HBase Users
11 members
-
Hadoop Cascading
1 member
-
Hadoop Administrators
9 members
© 2012 Created by Jason Venner.
