Senior Data Engineer

EPAM is committed to providing our global team of 36,700+ EPAMers with inspiring careers from day one. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success and we value collaboration, try to always understand our customers’ business, and strive for the highest standards of excellence. In today’s new market conditions, we continue to support operations for hundreds of clients around the world remotely, with the vast majority of our teams working from home. No matter where you are located, you’ll join a dedicated, diverse community that will help you discover your fullest potential.

DESCRIPTION

We are looking for a Senior Data Engineer to help build and manage our Client’s big data streaming technologies. You will be deeply involved with optimizing our existing streaming services, evaluating new technologies, managing cloud infrastructure and more. Our ingestion pipelines peak at over 90GB per minute. If you are interested in working with data at massive scale, let’s have conversation!

RESPONSIBILITIES

• Building and supporting highly available streaming services, written in Java/Scala using Apache Flink
• Operating and developing applications on distributed NoSQL key-value stores such as HBase, DynamoDB or FoundationDB
• Managing cloud infrastructure launched in AWS via Terraform
• Participating in an on-call rotation for our client’s streaming tech stack
• Evaluating new technologies and components of the big data ecosystem that are not yet part of our environment

REQUIREMENTS

• Experience building high throughput Java/Scala streaming services using technologies such as Flink or Spark
• Strong understanding of distributed message brokers such as Kafka and Kinesis
• Experience with performance tuning of distributed computing technologies at massive scale
• Experience working with AWS services such as Kinesis, EC2, EMR, RDS via infrastructure as code technologies
• Experience working with high throughput, distributed NoSQL databases
• Capable of independently performing root cause analysis on high throughput systems

WE OFFER

• Competitive compensation depending on experience and skills
• Opportunity to work on leading edge platforms, working in a fast-paced, agile, software engineering culture
• Knowledge-sharing with colleagues from EPAM's global tech communities
• Unlimited access to LinkedIn learning solutions
• Regular performance feedback and salary reviews
• Opportunities for professional growth