Big Data Engineer

Big Data Engineer

City :Tampa

State :FL

Job Description :

TOP REQUIREMENTS:
Big Data (Spark, Scala, Hive, Hadoop Ecosystem)
Data Streaming (Kafka)

Responsibilities

• Building and supporting a cloud based analytical platform for complex data systems.
• Document technical applications, specifications, and enhancements.
• Collaborate with business and technical stakeholders while defining solutions.
• Collaborate with the data scientists to organize huge sets of data for data modeling.
• Recommend ways to improve data reliability, quality and efficiency.
• Lead engineers in making sound, sustainable, and practical technical decisions.
• Foster high-performance, collaborative technical work resulting in high-quality output.
• Compile and present key findings and reports to all levels of the organization, including senior leadership.

What skills/attributes are a must have?

• 5+ years of experience with Big Data (HDFS, MapReduce, Hive, HBase, Pig, Sqoop, Spark, Scala).
• Experience building and optimizing data pipelines, architectures and data sets.
• Experience with data modelling, data management and ETL tools like Kafka Connect, Informatica etc.
• Experience building and deploying applications to the cloud (AWS, Azure, etc.).
• Experience working in an Agile environment.
• Expertise with modern programming languages, systems, and architectures.

What skills/attributes are nice to have?

• BA/BS degree in Computer Science or equivalent experience.
• Experience with the use of containers such as Kubernetes and Docker.
• Experience with DevOps, Continuous Integration, and Continuous Delivery.
• Expertise in performance and scalability optimization.
• Knowledge of software and infrastructure security practices.