Role description
Job Summary
Seeking a Specialist with 5 to 7 years of experience skilled in Scala and Apache Spark to design and maintain scalable big data solutions within the Hadoop and Spark ecosystem
Job Description
Design develop and maintain scalable data processing applications using Scala and Apache Spark Collaborate with crossfunctional teams to gather requirements and translate them into efficient big data solutions Implement data ingestion transformation and aggregation pipelines leveraging Spark and SparkSQL Ensure high performance reliability and scalability of data processing workflows Optimize existing data processing jobs for improved efficiency and resource utilization Stay updated with emerging technologies and best practices in big data and functional programming
Roles and Responsibilities
Lead the development and deployment of complex big data applications using Apache Spark and Scala frameworks
Mentor junior team members and provide technical guidance on Scala and big data technologies
Collaborate with data engineers architects and analysts to design endtoend data solutions
Troubleshoot and resolve performance bottlenecks in distributed data processing jobs
Develop and maintain documentation related to architecture design and code
Drive innovation by evaluating and integrating new tools and frameworks within the Hadoop and Spark ecosystem
Ensure adherence to coding standards security policies and compliance requirements
Job Summary
Seeking a Specialist with 5 to 7 years of experience skilled in Scala and Apache Spark to design and maintain scalable big data solutions within the Hadoop and Spark ecosystem
Job Description
Design develop and maintain scalable data processing applications using Scala and Apache Spark Collaborate with crossfunctional teams to gather requirements and translate them into efficient big data solutions Implement data ingestion transformation and aggregation pipelines leveraging Spark and SparkSQL Ensure high performance reliability and scalability of data processing workflows Optimize existing data processing jobs for improved efficiency and resource utilization Stay updated with emerging technologies and best practices in big data and functional programming
Roles and Responsibilities
Lead the development and deployment of complex big data applications using Apache Spark and Scala frameworks
Mentor junior team members and provide technical guidance on Scala and big data technologies
Collaborate with data engineers architects and analysts to design endtoend data solutions
Troubleshoot and resolve performance bottlenecks in distributed data processing jobs
Develop and maintain documentation related to architecture design and code
Drive innovation by evaluating and integrating new tools and frameworks within the Hadoop and Spark ecosystem
Ensure adherence to coding standards security policies and compliance requirements