HimalayasHimalayas logo
Bright Vision TechnologiesBT

Hadoop Developer

We help our clients hire innovative talents. Bright Vision Technologies is a minority-owned organization, founded in July 2020, based in New Jersey, USA.

Bright Vision Technologies

Employee count: 11-50

United States only

Stay safe on Himalayas

Never send money to companies. Jobs on Himalayas will never require payment from applicants.

We are seeking an experienced Hadoop Developer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems.

Requirements

  • Design, develop, and operate end-to-end big-data pipelines on Hadoop, ingesting data from a diverse mix of relational, file-based, streaming, and API-driven sources.
  • Build robust ETL/ELT workflows using Apache Spark, Hive, Pig, and Sqoop, with strong attention to data quality, idempotency, error handling, and recoverability.
  • Develop high-throughput streaming data pipelines using Kafka, Spark Streaming, or Flink, and integrate them with downstream analytical and operational systems.
  • Optimize Spark and MapReduce jobs through careful tuning of partitioning, memory, serialization, and skew handling to meet demanding SLAs at minimal cost.
  • Design and maintain data models and storage layouts on HDFS, Hive, HBase, and modern lakehouse formats (Parquet, ORC, Delta, Iceberg, Hudi) to balance flexibility and performance.
  • Implement data governance, lineage, and quality controls in collaboration with data governance and security teams.
  • Build robust monitoring, alerting, and logging strategies for big-data pipelines, including job-level SLAs and proactive failure detection.
  • Partner with data scientists and analysts to deliver curated, reliable, and well-documented datasets that accelerate their work.
  • Automate pipeline orchestration using Airflow, Oozie, or similar workflow engines, with clean dependency management and clear ownership boundaries.
  • Continuously evaluate and adopt new technologies in the big-data and cloud ecosystem (EMR, Databricks, Snowflake, BigQuery) where they offer meaningful improvements.
  • Lead performance reviews and architecture audits of existing pipelines, proposing concrete refactoring and optimization initiatives.
  • Document data architectures, schemas, pipeline behaviors, and operational runbooks in a way that makes the platform supportable as the team scales.
  • Mentor junior engineers and contribute to the team’s engineering standards and best practices.

Benefits

  • Competitive base salary commensurate with experience, plus benefits.

About the job

Apply before

Posted on

Job type

Full Time

Experience level

Location requirements

Hiring timezones

United States +/- 0 hours

About Bright Vision Technologies

Learn more about Bright Vision Technologies and their company culture.

View company profile

We help our clients hire innovative talents.

Bright Vision Technologies is a minority-owned organization, founded in July 2020, based in New Jersey, USA. Our mission is to deliver top-tier staffing and IT consulting services to our valued partners. Our profound proficiency in strategic staffing and application management transforms IT into a strategic asset. We firmly believe that by empathizing with our customers, understanding their needs, and delivering with unwavering attention to quality, all other aspects will naturally fall into alignment.

We take great pride in offering a comprehensive array of services to our clients, characterized by the provision of exceptional talent across a diverse spectrum of industries. Our commitment to delivering excellence transcends boundaries, ensuring that our clients have access to top-tier professionals who are meticulously matched to their specific needs.

Our core areas of service extend to the following industries:

Information Technology: In the ever-evolving IT landscape, we are adept at identifying and sourcing top talent across a wide array of roles, ensuring that our clients remain at the forefront of technological innovation.

Cyber Security & Intelligence: Within the realm of digital security and intelligence, we specialize in connecting organizations with professionals who possess the expertise to navigate the complexities of cybersecurity, data protection, and intelligence.

US Armed Services: Our commitment to supporting the U.S. Armed Services spans various sectors, ensuring that organizations have access to vital talent within Defense, Aerospace, Navy, Army, and Military, as well as in roles requiring TOP SECRET CLEARANCE.

Apparel, Retail, Food, and Beverage: In the dynamic and competitive world of retail, apparel, food, and beverage, we excel in connecting businesses with professionals who drive growth, innovation, and customer satisfaction.

Automotive, Aerospace, and Transport: Within these industries, our expertise extends to identifying and securing talent with the skills and knowledge required for success in rapidly evolving sectors.

Engineering and Manufacturing: We facilitate the recruitment of exceptional professionals who play a pivotal role in optimizing processes, enhancing efficiency, and ensuring quality in engineering and manufacturing.

Banking, Finance, Investment, and Insurance: In the financial sector, our focus is on identifying individuals who can navigate complex markets, manage investments, and provide vital financial services.

Government: We understand the unique demands of the public sector, and our services encompass the recruitment of professionals who can serve constituents effectively and meet the challenges of government organizations.

Healthcare, Pharma, and Biotech: We excel in the provision of clinical and non-clinical healthcare professionals who contribute significantly to patient care and medical advancements.

Oil, Gas, and Energy: Our expertise extends to the energy sector, where we facilitate the recruitment of professionals who drive innovation, efficiency, and sustainable energy solutions.

Digital & Information Security and Defense Services: In the realm of digital and information security and defense, we specialize in locating individuals who safeguard sensitive data and protect national interests. Our overarching goal is to serve as the bridge between dynamic industries and dynamic professionals. Through a combination of industry expertise, an extensive network, and a commitment to excellence, we connect organizations with the exceptional talent needed to drive success and innovation in their respective sectors.

Claim this profileBright Vision Technologies logoBT

Bright Vision Technologies

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

37 remote jobs at Bright Vision Technologies

Explore the variety of open remote roles at Bright Vision Technologies, offering flexible work options across multiple disciplines and skill levels.

View all jobs at Bright Vision Technologies

Remote companies like Bright Vision Technologies

Find your next opportunity by exploring profiles of companies that are similar to Bright Vision Technologies. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan