Join our community of SUBSCRIBERS and be part of the conversation.

To subscribe, simply enter your email address on our website or click the subscribe button below. Don't worry, we respect your privacy and won't spam your inbox. Your information is safe with us.

[td_block_social_counter style=”style7 td-social-boxed” manual_count_instagram=”32111″ instagram=”#” twitch=”#” manual_count_twitch=”11243″ tiktok=”#” manual_count_tiktok=”32214″ f_network_font_family=”tt-primary-font_global” f_counters_font_family=”tt-primary-font_global” tdc_css=”eyJhbGwiOnsibWFyZ2luLWJvdHRvbSI6IjAiLCJkaXNwbGF5IjoiIn19″]

News

Company:

Saturday, July 5, 2025

Data Engineer (Spark ,Scala, Elastic Search)

Share

Job title: Data Engineer (Spark ,Scala, Elastic Search)

Company: Unison Consulting Pte Ltd

Job description:

  • Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data
  • Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data
  • Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch
  • Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions
  • Implement data transformations, aggregations, and computations using Spark RDDs, DataFrames, and Datasets, and integrate them with Elasticsearch
  • Develop and maintain scalable and fault-tolerant Spark applications, adhering to industry best practices and coding standards
  • Troubleshoot and resolve issues related to data processing, performance, and data quality in the Spark-Elasticsearch integration

Requirements * 5+ Years as Data Engineer

  • 5 Years experience in Spark, Scala, Elastic Search
  • Develop and maintain scalable and fault-tolerant Spark applications, adhering to industry best practices and coding standards
  • Monitor and analyze job performance metrics, identify bottlenecks, and propose optimizations in both Spark and Elasticsearch components
  • Stay updated with emerging trends and advancements in the big data technologies space to ensure continuous improvement and innovation

Expected salary: 136281808 per year

Location: Hanoi

Job date: Sun, 18 Feb 2024 23:38:58 GMT

Apply for the job now!

Blogger
Bloggerhttp://www.saigonblogger.com
Explore the world of business, finance, and lifestyle with Saigon Blogger Newspaper. Let us be your companion on the path to success and fulfillment.

Read more

Local News