庄周梦蝶

生活、程序、未来
   :: 首页 ::  ::  :: 聚合  :: 管理

Yahoo! s4和Twitter storm的粗略比较

Posted on 2011-11-08 22:25 dennis 阅读(13164) 评论(14)  编辑  收藏 所属分类: javaHadoop与分布式
Items\Projects
Yahoo! s4
Twitter Storm
协议
Apache license 2.0
Eclipse Public License 1.0
开发语言
Java
Clojure,Java,Clojure编写了核心代码
结构
去中心化的对等结构
有中心节点nimbus,但非关键
通信
可插拔的通讯层,目前是基于UDP的实现 基于facebook开源的thrift框架
事件/Stream
<K,A>序列,用户可自定义事件类 提供Tuple类,用户不可自定义事件类,
但是可以命名field和注册序列化器
处理单元 Processing Elements,内置PE处理
count,join和aggregate等常见任务
Bolt,没有内置任务,提供IBasicBolt处理
自动ack
第三方交互
提供API,Client Adapter/Driver,第三方客户端输入或者输出事件 定义Spout用于产生Stream,没有标准输出API
持久化 提供Persist API规范,可根据频率或者次数做
持久化
无特定API,用户可自行选择处理
可靠处理 无,可能会丢失事件 提供对事件处理的可靠保证(可选)
路由EventType + Keyed attribute + value匹配
内置count,join和aggregate标准任务
Stream Groupings:
Shuffle,Fields,All,Global,None,Direct
非常灵活的路由方式
多语言支持 暂时只支持Java多语言支持良好,本身支持Java,Clojure,
其他非JVM语言通过thrift和进程间通讯
Failover
 部分支持,数据无法failover 部分支持,数据同样无法failover
Load Balance
不支持 不支持
 并行处理 取决于节点数目,不可调节 可配置worker和task数目,storm会尽量将worker和task均匀分布
动态增删节点不支持
 支持
动态部署
 不支持 支持
web管理 不支持 支持
代码成熟度 半成品 成熟
活跃度 低 活跃
编程 编程 + XML配置
  纯编程
参考文档 http://docs.s4.io/https://github.com/nathanmarz/storm/wiki/
http://xumingming.sinaapp.com/category/storm/ (非常好的中文翻译)

评论

# re: Yahoo! s4和Twitter storm的粗略比较  回复  更多评论   

2012-02-10 11:04 by soon
你好,请问一下,为什么s4和storm都不提供load balance?是因为没有这个必要吗?

# pedalcarsforkids9847  回复  更多评论   

2015-02-10 02:29 by Article writing is also a fun, if you know afterwa
Article writing is also a fun, if you know afterward you can write if not it is difficult to write.

# serwislod�wek46019  回复  更多评论   

2015-02-13 21:45 by Do you mind if I quote a few of your articles as l
Do you mind if I quote a few of your articles as long as I provide credit and sources back to your blog? My blog site is in the very same area of interest as yours and my users would truly benefit from a lot of the information you provide here. Please let me know if this ok with you. Regards!

# mebleogrodowe98869  回复  更多评论   

2015-03-08 11:45 by For most recent news you have to go to see world w
For most recent news you have to go to see world wide web and on web I found this site as a finest website for most recent updates.

# giftsonlineplease59150  回复  更多评论   

2015-03-09 03:00 by Greate post. Keep writing such kind of info on you
Greate post. Keep writing such kind of info on your page. Im really impressed by it.
Hey there, You've performed an incredible job. I will certainly digg it and in my view suggest to my friends. I am sure they will be benefited from this site.

# pałkiteleskopoweundercover50575  回复  更多评论   

2015-03-17 10:12 by Very great post. I simply stumbled upon your weblo
Very great post. I simply stumbled upon your weblog and wished to say that I've really enjoyed surfing around your blog posts. After all I will be subscribing for your rss feed and I'm hoping you write once more very soon!

# tumblrcom48630  回复  更多评论   

2015-03-17 11:16 by Hello I am so happy I found your webpage, I really
Hello I am so happy I found your webpage, I really found you by mistake, while I was browsing on Bing for something else, Anyhow I am here now and would just like to say many thanks for a remarkable post and a all round exciting blog (I also love the theme/design), I don’t have time to browse it all at the moment but I have saved it and also included your RSS feeds, so when I have time I will be back to read a great deal more, Please do keep up the awesome b.

# nieruchomości69708  回复  更多评论   

2015-03-17 18:19 by Do you mind if I quote a couple of your posts as l
Do you mind if I quote a couple of your posts as long as I provide credit and sources back to your website? My blog site is in the exact same niche as yours and my users would really benefit from some of the information you present here. Please let me know if this okay with you. Thanks!

# bus38946  回复  更多评论   

2015-03-24 11:20 by Remarkable things here. I'm very glad to look your
Remarkable things here. I'm very glad to look your post. Thanks a lot and I'm taking a look ahead to touch you. Will you kindly drop me a e-mail?

# salehoo23538  回复  更多评论   

2015-03-24 23:39 by You just need to make an online website to list th
You just need to make an online website to list the items against the wholesale jewellery dropshipping. Article Source: Milton has over ten years experience as a professional writer and reviewer. To earn real money as you work from home means that you must make customers interested in your products all the time.

# gamblinglinkbuildingservice35216  回复  更多评论   

2015-04-06 10:16 by Hi there to every , since I am really keen of read
Hi there to every , since I am really keen of reading this weblog's post to be updated daily. It contains good stuff.

# kujawskie98673  回复  更多评论   

2015-05-08 12:05 by What's up, all is going well here and ofcourse eve
What's up, all is going well here and ofcourse every one is sharing data, that's truly excellent, keep up writing.

# bbwporndvd81160  回复  更多评论   

2015-12-01 12:42 by I like the valuable information you supply in your
I like the valuable information you supply in your articles. I will bookmark your weblog and take a look at once more here regularly. I'm rather sure I'll be informed plenty of new stuff right right here! Good luck for the next!

# chaturbatetokenhack33789  回复  更多评论   

2016-05-17 13:02 by It's user-friendly and easy so individuals may emp
It's user-friendly and easy so individuals may employ it without difficulty.

只有注册用户登录后才能发表评论。


网站导航: