What is a Big Data Analyst?

Big Data Analysts correspond to the CDA Level 2 Big Data Analyst exam. They focus on building techniques for managing data models, scrutinizing data and providing reports and visualizations to explain hidden insights in the data, model optimization and improvement, and more. The salary you can get: big data analysts are pivotal in programming frameworks as architectural builders, and generally earn 25k-50k per month Theoretical foundation: statistics, probability theory and databases, data mining, JAVA fundamentals, Linux fundamentals Software Requirements: essential SQL, Hadoop, HDFS, Mapreduce, Mahout, Hive, Spark; optional R, Hadoop, Hbase, ZooKeeper, Pig, etc. Business Analysis Ability: familiar with hadoop+hive+spark for big data analysis architecture design, and be able to put forward big data architecture solution ideas for different businesses. Master the functions and application scenarios of Spark MLlib, SparkSQL on hadoop+hive+ Spark+tableau platform, and select appropriate components for analysis and processing according to different data business requirements. And compare, analyze and improve the model proposed based on Spark framework. Ability to present results: the report can reflect the advantages of big data analysis, and can clearly explain the interpretation of data collection, big data processing process and final results, as well as propose the optimization and improvement of the model, in order to facilitate the enhancement of the business value of big data analysis.