SOFTWARE DEVELOPMENT ENGINEER, AWS MANAGED STREAMING FOR KAFKA (MSK)
Full-time · Mid-Senior level
10,001+ employees · IT Services and IT Consulting
About the job
Come build the future of data streaming with the Amazon Managed Streaming for Kafka (MSK) team!
We are seeking builders for our Amazon MSK service, a fully managed service that makes it easy for customers to build and run applications that use Apache Kafka to process streaming data. We are looking for engineers who are enthusiastic about data streaming, and are as passionate about contributing to open source as they are about solving real customers' business needs, at AWS scale.
As a member of the Amazon MSK team, you will be making contributions to the entire stack - the APIs and the workflows that make up the MSK service, the core Kafka platform, and stand-alone tools that make it easier for Kafka community to operate Kafka better. Upstream compatibility is a core tenet of MSK. Your code changes to the Kafka platform will be released back to open source. As a member of a new AWS service that builds on top of a popular open source technology, this is a unique opportunity to work on a team that straddles both worlds – open source and Amazon-internal software. You will design and build new features, make performance improvements, identify and investigate new technologies, prototype solutions, build scalable services, and test and review changes, to deliver an exceptional customer experience.
The ideal candidate has experience designing large-scale systems supporting millions of transactions per second, enjoys solving complex software problems, and possesses design and problem-solving skills. Ideally you have an in-depth understanding of streaming data technologies like Amazon Kinesis or Apache Kafka, and experience with open-source data processing frameworks like Apache Spark, Apache Flink, or Apache Storm. Your responsibilities will include collaborating with other engineers to build a large scale AWS service, and work with senior leaders to define your team's roadmap, including identifying design and code changes needed in the underlying open source platforms.
- Bachelor's degree in Computer Science (or equivalent) experience
- Several years experience of developing production software systems, including taking product requirements through to production
- Software engineering skills including the ability to write maintainable, and robust code in an object oriented language
- Proficiency in computer science fundamentals – data structures, algorithms and OO design
- Effective communication skills and ability to work effectively on shared projects with designers, artists, testers, and other developers
- Experience building high volume and highly scalable online services
- Experience operating highly available services
- Experience with distributed systems, consistent hashing, distributed locking, checkpointing, and load balancing
- Experience in Java, Scala and scripting
- Working knowledge of Hadoop, MapReduce, Kafka, Kinesis, Spark or other Big Data processing platforms
Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice (https://www.amazon.jobs/en/privacy_page) to know more about how we collect, use and transfer the personal data of our candidates.
Company - Evi Technologies Limited
Job ID: A2139128
12% Off All Orders Hansen’s has everything you need to keep you looking and feeling coastal cool.
12% Off All Orders Hansen's is one of the oldest and largest surf shops in Southern California. With over 55 years doing business in Encinitas CA we have one of the most recognized names in surf retai
Limited Edition UCE-13 PLUS Water Ionizer in Matte Black 40% Off + 7 FREE Gifts with code: HAPPYTIMES at checkout. Shop Now!
Happy New Year Sale! Lowest Prices Ever! Use code: HAPPYTIMES at checkout for 7 FREE Gifts with purchase of a water ionizer. Shop Now!
38% Off Tyent's ACE-13 Above-Counter Extreme Water Ionizer - Lowest Price Ever! Plus, 7 FREE Gifts with code: HAPPYTIMES at checkout. Shop Now!
35% Off Tyent's NEW UCE-13 PLUS (in Satin Silver) Water Ionizer - Lowest Price Ever! Plus, 7 FREE Gifts with code: HAPPYTIMES at checkout. Shop Now!
34% Off Tyent's H2 Hybrid Ionizer - Lowest Price Ever! Plus, 7 FREE Gifts with code: HAPPYTIMES at checkout. Shop Now!
33% Off Tyent's EDGE-9 Turbo Water Ionizer - Lowest Price Ever! Plus, 7 FREE Gifts with code: HAPPYTIMES at checkout. Shop Now!
Up to 33% Off Tyent's NEW UCE-13 PLUS Water Ionizer + 7 FREE Gifts with code: PRESIDENT22 at checkout. Shop Now!