Big Data Engineer
TITLE IS: BIG DATA ENGINEER (not software engineer)
• 8 + years of professional experience
• 3+ years of experience with Big data technology and analytics
• 3+ years of experience in ETL and ELT data modeling
• Experience working with traditional warehouse and correlation into hive warehouse on bigdata technologies
• Experience setting data modeling standards in Hive
• Proficiency in using query languages such as SQL, Hive
• Experience with streaming stacks like Nifi, Spark and PySpark
• Experience working with ELK stack or Solar indexing
• Understanding of data governance, bigdata security like kerberos, ranger
• Knowledge of setting standards around data dictionary and tagging data assets within datalake for business consumption.
• Understanding of Big Data tools (e.g., NoSQL DB, Hadoop, Hbase) and API development consumption.
• Understanding of data preparation and manipulation using Datameer tool
• Knowledge of SOA, IaaS, and Cloud Computing technologies, particularly in the AWS environment
• Experience with Hadoop/Hive, Spark and Scoop highly desirable
• Experience in one or more languages (e.g., Python or Java, Groovy)
• Experience with data visualization tools like Tableau, Power BI