工作小结-Y-1

三月 10th, 2014 by klose | No Comments | Filed in 成长历程

Conclusion_201310-201403 最近在Y公司的Hadoop Team,这几个月对我的影响还是挺大的,感觉收获了不少: 1) Get catch of Hadoop/Yarn Again. Before I graduated from ICT, I had spent lots of time in researching Distributed computing framework, then due to my first job as to HBase, they were set aside. Now when I get back to the subject, I feel very excited and a little unfamiliar. Hadoop Security, Yarn log policy, Container lifetime, etc. 2) Acquire a lot of practice how to maintain or manager large number of normal users, especially in multi-tenant data-sharing environment. 3) Touch and become familiar with some other components in hadoop-ecosystem. Oozie – a very useful work flow and co

2013~光明

二月 16th, 2013 by klose | 5 Comments | Filed in 成长历程

作为2012年的个人总结的文字,放到新的一年生活和工作开始的时刻,经历了春节假期的思考,特别想正式地给2012年做一下告别,非文艺,仅是个人爱好和习惯。 2012年对于我个人最大事情莫过于,终于从学校走向了社会。当“屌丝”“你幸福吗”“雾霭”“18大”成为了帝都人民津津乐道的话题时,我独自一人在繁华并不适应的CBD和第一份工作进行着演习。生活最大的乐趣,就是在不同的环境中找到自己,活得有尊严不是我们这一代人(80后)应有的态度,但是活得要有自我才是我们这一代人所最值得尊重的品格。要有选择的适应周围的环境,是保持自我、坚守信念最和谐的方式。回顾这工作的半年多的日子,我深刻体会到,要善于读懂“法海”的思维。我记得在和大家讨论什么样的工作才是一份好的工作时,我曾说过,周围的环境能够支撑你做自己喜欢的事情,并收获认同。

Tags: , ,

我正在做的事情…

七月 19th, 2012 by klose | No Comments | Filed in 成长历程, 网站碎片

2016~Now Build and optimize middle scale of big-data platform (100~1000) Data Ingestion Pipeline including batch and realtime Drive customized query engine for video ads data (Powered by Presto) Lead big-data platform shift from on-premise to AWS. Data oriented integration test framework. Cost efficiency under AWS Cloud Present 3 speeches on QCon 2017 and ArchSummit2017, ArchSummit2019 respectively. The evolution of FreeWheel Data Platform http://2017.qconbeijing.com/presentation/844/ The practice of FreeWheel OLAP https://archsummit.infoq.cn/2017/beijing/presentation/242 The practice of FreeWheel Real-Time Platform https://archsummit.infoq.cn/2019/beijing/presentation/2062 201