Software Engineering Specialist

Who are we?

Amdocs helps those who build the future to make it amazing. With our market-leading portfolio of software products and services, we unlock our customers’ innovative potential, empowering them to provide next-generation communication and media experiences for both the individual end user and enterprise customers. Our approximately 30,000 employees around the globe are here to accelerate service providers’ migration to the cloud, enable them to differentiate in the 5G era, and digitalize and automate their operations. Listed on the NASDAQ Global Select Market, Amdocs had revenue of $4.89 billion in fiscal 2023.

In brief

As a Development Expert, you will be responsible for designing, developing, and supporting data-driven solutions within the data warehousing and analytics domain. You will work with cutting-edge technologies, including Azure Databricks, Spark, Snowflake, and other cloud platforms, to build and optimize data pipelines. Your role will involve working on end-to-end development, production support, and system enhancements while ensuring high performance and scalability of data solutions.

What will your job look like?

• End-to-End Development: Design, develop, and deploy high-performance data pipelines and ETL solutions using Azure Databricks, Spark, and cloud-based data warehousing solutions.
• Design & Architecture: Understand high-level design and application interface design and contribute to the low-level design. Provide recommendations for technical improvements and application optimizations.
• Technical Solutioning: Perform application analysis to propose technical solutions for enhancements and issue resolution.
• Coding & Testing: Write efficient and optimized SQL, PL/SQL, Spark, and shell scripts, conduct unit testing, and deploy solutions in production.
• Production Support: Troubleshoot and resolve production issues (Tier 2 Support, including weekend on-call rotation) to ensure adherence to SLAs.
• Documentation & Compliance: Create comprehensive technical documentation covering design, development, and support for all project deliverables.

All you need is...

As a Development Expert, the candidate should have hands-on expertise in cutting-edge cloud-native data engineering technologies. The mandatory technical skills required for this role include:

Cloud Data Engineering & ETL Development

• Azure Databricks: At least 2+ years of hands-on experience in Azure Databricks for building, optimizing, and managing data pipelines.
• Apache Spark (PySpark/Scala/Java): Minimum 4+ years of experience in Spark-based distributed data processing to handle large-scale datasets efficiently.
• Delta Lake: Strong knowledge of Delta Lake architecture and optimization techniques like Z-Ordering, Bloom Filters, and Optimize/Vacuum operations.
• Cloud-Based Data Warehousing: Minimum 3+ years of hands-on experience working with Snowflake/ Google BigQuery/DataBricks for data transformations, performance tuning, and cost optimization.
• ETL & Data Pipelines: Expertise in designing and developing end-to-end data pipelines using Cloud ETL tools (Databricks Pipelines, ADF, or equivalent).

Version Control:

• Experience working with Azure Repos, GitHub, or Bitbucket for source code management and collaboration. Advanced SQL, Performance Optimization & Security
• Advanced SQL & PL/SQL: Ability to write, optimize, and debug complex queries on Snowflake, BigQuery, or other cloud databases.
• Query Performance Tuning: Strong knowledge of clustering, partitioning, caching, indexing strategies, materialized views, and query tuning techniques in cloud databases.

Scripting, Automation & Orchestration:

• Python & PySpark: Hands-on experience in Python scripting for ETL automation, data transformation, and API integrations.
• Unix/Linux & Shell Scripting: Strong expertise in writing advanced shell scripts for automation, scheduling, and log management.
• Job Scheduling & Workflow Orchestration: Experience with Apache Airflow, Azure Data Factory for orchestrating complex data workflows.

Emerging Technologies & Best Practices:

• Data Streaming & Real-Time Processing: Exposure to Apache Kafka, Azure Event Hubs, or Confluent Kafka for handling real-time data ingestion.
• Machine Learning Integration (Good to Have): Understanding of MLFlow, Feature Store, or AutoML for incorporating ML models into data pipelines.
• DataOps & Observability: Familiarity with Prometheus for monitoring and observability of data pipelines.

Key Takeaways:

• Strong expertise in Azure Databricks, Apache Spark, and Cloud Data Warehouses (Snowflake/BigQuery).
• Deep understanding of ETL architecture, performance optimization, and DevOps automation.
• Proficiency in Python, SQL, Unix scripting, and workflow orchestration tools.
• Experience in cloud security, data governance, and emerging technologies like real-time streaming and ML integration.
• Bachelor's degree in Science/IT/Computing or equivalent and 7-8 years' experience as a software engineer or a software support engineer.

Good to have:

• Experience with other ETL technologies (Oracle, Qlik Replicate, Golden Gate, Hadoop).
• Passion for continuous learning and adapting to new data warehousing technologies.

Why you will love this job:

• The chance to serve as a specialist in software and technology.
• You will take an active role in technical mentoring within the team.
• We provide stellar benefits from health to dental to paid time off and parental leave!

#LI-AS1