Data Engineer, Video Platform - USDS

About TikTok U.S. Data Security
TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. U.S. Data Security (“USDS”) is a subsidiary of TikTok in the U.S. This new, security-first division was created to bring heightened focus and governance to our data protection policies and content assurance protocols to keep U.S. users safe. Our focus is on providing oversight and protection of the TikTok platform and U.S. user data, so millions of Americans can continue turning to TikTok to learn something new, earn a living, express themselves creatively, or be entertained. The teams within USDS that deliver on this commitment daily span across Trust & Safety, Security & Privacy, Engineering, User & Product Ops, Corporate Functions and more.

Why Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.

In order to enhance collaboration and cross-functional partnerships, among other things, at this time, our organization follows a hybrid work schedule that requires employees to work in the office 3 days a week, or as directed by their manager/department. We regularly review our hybrid work model, and the specific requirements may change at any time.

About the team
TikTok video system is a world-leading video platform that provides multimedia storage, delivery, transcoding services. As part of the USDS, the Video Platform team is responsible for building the next generation video processing platform which provides excellent experiences for billions of users around the world.
About the role:
As a Data Engineer, you will be instrumental in shaping strategic decisions within the TikTok video platform. This role emphasizes building, optimizing, and maintaining robust data processing architectures that support new data and ETL pipelines. Your expertise will ensure that data flows reliably and accurately across various systems, empowering stakeholders with high-quality, actionable insights that impact quality of service, quality of experience and cost optimizations.

Responsibilities
- Craft optimal end to end data processing architecture and systems for new data and ETL pipelines
- Design, build, and maintain efficient and reliable data pipelines to move and transform big datadata
- Implement and monitor quality control measures to ensure data accuracy, completeness, and consistency
- Drive internal process improvements and automate manual processes for data quality and service level agreement (SLA) management
- Create and maintain technical documentation, such as data dictionaries, data flow diagrams, and system documentation, to ensure efficient and effective data management and analysis.
- Work closely with data engineering and various vertical teams within the Video platform and cross-functional teams within TikTok USDSMinimum Qualifications
- Bachelor's degree in Computer Science or a related technical background involving software/system engineering, or equivalent working experience
- 2+ years of experience working with data analytics and data engineering, including experience with data cleaning and preprocessing, data analysis and dashboard development.
- 2+ years of proficiency in distributed data processing using Big Data technologies such as Spark, Hadoop/HDFS, Flink, Hive, YARN, and Kafka
- Good programming experience with SQL and at least one of the following languages: Java, Python, Go, or Scala
- Experience in data analytics and data engineering ETL development, data pipeline design, implementation, and maintenance
Preferred Qualifications
- Demonstrated independent thinking capabilities and troubleshooting skills in large scale distributed systems
- Good communication and coordination skills
- Strong background in algorithms and data structures
- Experience in building data solutions with AWS, Google, Azure and other cloud services is a plus

Candidates for this position must be legally authorized to work in the United States. This position is not eligible for visa sponsorship or support.

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://shorturl.at/ktJP6

This role requires the ability to work with and support systems designed to protect sensitive data and information. As such, this role will be subject to strict national security-related screening.