Assistant Vice President, Python & Apache Spark Big Data Engineer Greater Pune, India Area

The Company is seeking an Assistant Vice President with a strong background in Python and Apache Spark for a Big Data Engineer role. The ideal candidate will have 8 to 12 years of experience and a proven track record in application performance tuning, troubleshooting, and the implementation of these skills in the Big Data domain. Responsibilities for this position include translating application storyboards and use cases into functional applications, designing, building, and maintaining efficient Python/Scala code, and ensuring the best possible performance, quality, and responsiveness of the applications. The role also involves identifying and resolving bottlenecks and bugs, developing high-performance and low-latency components for Spark clusters, and collaborating with global teams to propose best practices and standards. Applicants must have a strong experience with one or more programming languages, particularly Python and Spark, and be comfortable working with large data volumes. A firm understanding of logical data structures and analysis techniques, as well as experience in Big Data technologies such as HDFS, Map Reduce, YARN, Apache Spark, and Hive, is essential. Familiarity with data formats like Avro, Parquet, CSV, and JSON, and a good knowledge of database principles and SQL are also required. The candidate should have a background in systems analysis, design, and architecture, and be experienced in SDLC activities. Experience with Agile/Scrum methodology, SCMs like GIT, and tools like JIRA is a plus, as is familiarity with NoSQL databases, build tools such as Maven, continuous integration like Jenkins/Team City, and cloud and container technologies.

Hiring Company

Citi