Software Engineer - Data Platform

Are you prepared to join the X team and help build the ultimate real-time information-sharing app, revolutionizing how people connect? At X, we’re on a mission to become the trusted global digital public square, committed to protecting freedom of speech and building the future unlimited interactivity. Our goal is to empower every user to freely create and share ideas, fostering open public discourse without barriers. Join us in shaping this thrilling journey where your contribution will be invaluable to our success!

_

Who we are:

X serves our community of users and customers by working tirelessly to preserve free expression and choice, create limitless interactivity, and create a marketplace that enables the economic success of all its participants

We value:

• Highly motivated individuals, focused on engineering excellence

• Prioritizing impactful coding over extensive documentation

• Focusing on delivering products and platforms, not just discussing roadmaps

If this sounds like you, let’s talk.

What you will do: 

The Data Platform team is responsible for developing and managing a distributed data processing platform. Our focus areas include Apache Kafka, Spark, Flink, and Trino, along other supporting technologies. Our team tackles complex, impactful challenges at Petabyte scale. We develop vital platform components enabling ML and product teams to efficiently transport, process, and manage data at petabyte-scale.

As a software engineer in our team, you will:

• Design and develop core functionalities in data ingestion and processing

• Enhance and optimize Kafka and other transport layer technologies for real-time processing

• Work closely with other engineers to ensure that our data platform is available, secure, and reliable

• Uphold service quality throughout the software development lifecycle

• Drive continuous improvement in our software solutions

Qualifications:

We're looking for exceptional engineers who are passionate about our mission and have a strong desire to make a meaningful impact. The ideal candidate will have:

• Minimum 2+ years of backend development experience

• Proficiency in languages like Java, Scala, Python, Rust

• Experience in optimizing distributed data processing systems (Spark, Flink, Kafka, Hadoop, Storm) is highly desirable

• Knowledge of ETL processes and data warehousing

• Demonstrated experience building data pipelines

• Independent learning capabilities for new technologies

• Extremely committed, willing to work in a fast paced environment

• Excellent communication and interpersonal skills

At X, our small but fast-paced team values innovation, creativity, and a strong commitment to our mission. As a Data Platform Software Engineer, you'll have the opportunity to make a significant impact on the future of X and our aspiration to build the Everything App. 

If you're an exceptional engineer who shares our passion for freedom of speech, we'd love to hear from you.