Job Details

Join to apply for the Lead Big Data Engineer role at Relativity

2 days ago Be among the first 25 applicants

Join to apply for the Lead Big Data Engineer role at Relativity

Get AI-powered advice on this job and more exclusive features.

Job Overview

Join our team as we innovate the future of data platform architecture, enabling massive scaling and data processing for ML and Gen AI projects. You'll be at the forefront of processing vast unstructured data, building high-throughput APIs, and supporting distributed compute frameworks for seamless model deployment. Ready to dive into the heart of cutting-edge tech?

Posting Type

Hybrid

Job Overview

Join our team as we innovate the future of data platform architecture, enabling massive scaling and data processing for ML and Gen AI projects. You'll be at the forefront of processing vast unstructured data, building high-throughput APIs, and supporting distributed compute frameworks for seamless model deployment. Ready to dive into the heart of cutting-edge tech?

Job Description And Requirements

Your role in action

• Assist in building our next-generation data platform tooling and services to support the ingestion and processing of large volumes of documents at scale. Contribute to improving and extending our Spark-based distributed data processing pipeline.
• Help enhance our Rust-based distributed query engine used to request large amounts of document data.
• Create tools to automate and optimize processes across disciplines.
• Participate in the on-call schedule to investigate and fix production issues related to our data processing pipeline or query engine.
• Participate in code reviews for projects written by your team.
• Focus on quality through comprehensive unit and integration testing.
  
  

Your Skills

• 6+ years of software development experience in writing performant, commercial-grade systems and applications
• Experience with monitoring and troubleshooting production environments Proficiency in programming languages used in high volume data processing and applications like: Java or Scala and Python
• Experience building data pipelines with distributed compute frameworks like Hadoop. Spark, or Dask
• Knowledge of Linux/Unix systems, Docker/Kubernetes and CI/CD including scripting in Python or other scripting languages to automate build and deployment processes
• Knowledge of professional software engineering practices & software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
• Leverages best practices and past experiences to mentor and improve the productivity of the team
  
  

Wed particularly love it if you have: Deep experience building and debugging distributed data pipelines Experience with columnar databases and storage formats like Delta Lake and Parquet Experience deploying and managing services on Kubernetes Experience building with Rust

Relativity is committed to competitive, fair, and equitable compensation practices.

This position is eligible for total compensation which includes a competitive base salary, an annual performance bonus, and long-term incentives.

The expected salary range for this role is between following values:

$150,000 and $224,000

The final offered salary will be based on several factors, including but not limited to the candidate's depth of experience, skill set, qualifications, and internal pay equity. Hiring at the top end of the range would not be typical, to allow for future meaningful salary growth in this position.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at Relativity by 2x

Get notified about new Big Data Developer jobs in Louisiana, United States.

Alexandria, LA $80,000.00-$100,000.00 3 hours ago

Louisiana, United States $62,400.00-$112,400.00 5 hours ago

Lafayette, LA $51,400.00-$109,700.00 1 week ago

Louisiana, United States $126,000.00-$190,000.00 5 days ago

Louisiana, United States $126,000.00-$190,000.00 5 days ago

Staff Engineer - Finance Data Specialist (Remote)

New Orleans, LA $115,000.00-$260,000.00 1 week ago

Louisiana, United States $86,000.00-$154,700.00 5 hours ago

Senior Staff Engineer - Finance Data Specialist (Remote)

New Orleans, LA $115,000.00-$260,000.00 1 week ago

Data Engineer - Industrials & Energy Sector - Manager - Consulting - Location OPEN

Baton Rouge, LA $125,500.00-$230,200.00 6 days ago

New Orleans, LA $140,000.00-$185,000.00 1 week ago

Data Engineer - Industrials & Energy Sector - Manager - Consulting - Location OPEN

New Orleans, LA $125,500.00-$230,200.00 6 days ago

Onsite Data Center Design Electrical Engineer

Cyber SDC - Data Visualization Engineer - Senior - Consulting - Location Open

Cyber SDC - Data Visualization Engineer - Senior - Consulting - Location Open

New Orleans, LA $77,500.00-$140,900.00 1 week ago

New Orleans, LA $90,000.00-$160,000.00 2 weeks ago

Baton Rouge, LA $113,000.00-$173,000.00 4 hours ago

Shreveport, LA $90,000.00-$160,000.00 2 weeks ago

Data Center Structured Cabling-Project Engineer I | Mortenson

Data Center Structured Cabling-Project Engineer II | Mortenson

Baton Rouge, LA $113,000.00-$173,000.00 4 hours ago

Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr