TTT - Scala And Spark Developers - Staff
ey
Job Description
- Work Experience – 3 to 5 years of hands-on development experience specifically in Scala (Spark).
- Development experience with RDDs, writing code for performing actions, transformations using in-memory processing using Scala.
- Development experience in data frames and data sets and preparing notebooks in Scala for running jobs in spark.
- Experience with optimizing existing code for better performance and efficiency.
- Exposure on the database side (understanding of read / write queries, handling data volume) and basic understanding of NoSQL databases like Cassandra and Astra.
- Understanding of distributed computing and related technologies (Databricks).
- Hands on experience with development tools like IntelliJ.
- Knowledge on working with high data volume projects (reading and writing up to a million records per transaction).
- Basic debugging skills and Information Security knowledge.
- Be able to perform developer testing for the components written / modified by self.
- Be able to perform Performance and load testing from a development perspective.
- Be able to prepare development documents such as design notes, development test cases, WBS (work break down structure) and effort estimation.
- Knowledge and exposure to GitHub, Azure DevOps, code maintenance and CI/CD release processes.
- Exposure to Software development life cycle and agile methodologies.
- Degree in software engineering, computer science or similar.
- Good communication skills (verbal and written).