我正在做的事情

2016~Now

  • Build and optimize middle scale of big-data platform (100~1000)
  • Data Ingestion Pipeline including batch and realtime
  • Drive customized query engine for video ads data (Powered by Presto)
  • Lead big-data platform shift from on-premise to AWS.
  • Data oriented integration test framework.
  • Cost efficiency under AWS Cloud
  • Present 3 speeches on QCon 2017 and ArchSummit2017, ArchSummit2019 respectively.
    The evolution of FreeWheel Data Platform http://2017.qconbeijing.com/presentation/844/
    The practice of FreeWheel OLAP https://archsummit.infoq.cn/2017/beijing/presentation/242
    The practice of FreeWheel Real-Time Platform https://archsummit.infoq.cn/2019/beijing/presentation/2062
2015.03~2016.7
  • Audience Data Platform
  • Hadoop&HBase Platform
  • DMP Big-Data Pipeline
  • Microsoft Azure Data Platform

2013.10~2015.03

  • Yahoo Hadoop Team & Grid Solutions
  • Working on Hadoop, HBase, Pig, Hive/Hcatalog, Oozie, Spark, Storm
  • Grid Managements on tens of thousands of nodes
  • Provide techinical solutions for All Yahoo Grid users.

2012.07~2013.10

  • Responsible for research and development of HBase Kernel, provide high availability and performance in production.
  • Design and develop a new monitoring platform supporting real-time alarm and statistical analysis, which is compatible with distributed frameworks (Hadoop/HBase/Storm).
  • Responsible for HBase system troubleshooting, JVM parameter tuning, and table design.

2009.7~2012.6

Institute of Computing Technology, Chinese Academy of Sciences

Main research area:Big Data, distributed computing, resource management.
My research topic: The key technology for accelerating small jobs in distributed computing.
(面向小作业并行编程框架的关键技术研究[D]. 2012.)

From Binospace, post 我正在做的事情

文章的脚注信息由WordPress的wp-posturl插件自动生成

Do you have any comments on 我正在做的事情 ?