Spark Pipeline Developer, Music Services

Deadline: 22 May 2024

Employment term: Permanent

Category: Software development

Job type: Full time

Location: Yerevan

Job description:

Our client is a music services company that specializes in music publishing and rights management, offering technology-based solutions to artists, songwriters, and rights holders.
The focus of the role will be programming our Spark pipeline and the automated tests for it.

Job responsibilities

  • Develop and maintain Java/Scala/Python applications using modern Java (Java 11+) and Spring Boot
  • Design, implement, and optimize SQL queries and database interactions
  • Integrate Kafka for real-time data streaming and processing
  • Containerize applications using Docker for efficient deployment and scalability
  • Utilize AWS services for application deployment, monitoring, and management
  • Collaborate with cross-functional teams to design and implement AWS infrastructure using Terraform
  • Implement serverless solutions using AWS Lambda and orchestrate workflows with Step Functions
  • Manage data warehousing solutions, including Redshift, and implement data migration strategies using DMS
  • Port Oracle PL/SQL code as necessary and optimize for performance and compatibility
  • Optionally, contribute to projects involving Python for specific functionalities or automation tasks

Required qualifications

  • Experience with Java/Scala/Python programming languages
  • Experience in provisioning infrastructure, modifying CI/CD pipelines and programming a robust production system that can handle heavy loads
  • Experience with Spark
  • Experience with SQL expertise
  • Experience with Kafka
  • Experience with Docker
  • Previous AWS experience
  • Experience with Kubernetes
  • Terraform

Required candidate level: Senior

Additional information

Аpply online via staff.am and follow entire application process.

Professional skills

Java

Scala

Soft skills

Teamwork

Share this job via your favorite social media channel.

LOCATIONS

25 offices in USA, Latin America, Western and Eastern Europe and UK

 

View more

View Less

We are experts in

  • Finance
  • E-commerce and online-travel commerce
  • Healthcare & Life sciences
  • Media & Entertainment
  • IoT/M2M and wearable devices
  • Telecom
  • Retail & Distribution
  • iGaming
  • Cloud solutions
  • Machine learning
  • Big Data
  • Blockchain
  • Mobile technology
  • UX/UI design

View more

View Less

Learning & Development

  • Internal Courses
  • Learn Cafe Program (corporate access to LinkedIn Learning, study on other external educational platforms and get reimbursed)
  • Corporate Online Library (45K+ professional books)
  • Coaching Program
  • Tech Skills Mentoring Program
  • English & German Classes
  • Soft Skills Live Online Trainings

View more

View Less

Contact details

Phone: +37460509797

Address: Dzorapi 70/3, 7 floor Yerevan, Armenia, Yerevan, Armenia

Find DataArt Armenia on social media