[Remote] Data Engineer-Data Platforms-Google - 1

Other Jobs To Apply

Note: The job is a remote job and is open to candidates in USA. IBM Consulting helps companies advance their hybrid cloud and AI journeys through collaboration, technology, and innovative solutions. The Data Engineer will design, build, maintain, and optimize scalable batch and real-time data pipelines and data engineering solutions using Google Cloud data platforms and open-source technologies.


Responsibilities

  • Design Data Pipelines: Design and develop batch and real-time data pipelines for Data Warehouse and Datalake using Google Cloud services such as DataProc, DataFlow, PubSub, BigQuery, and Big Table
  • Develop Data Engineering Solutions: Build and maintain data engineering solutions using Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, Google DataFlow with Apache Beam or Python, and other open-source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala
  • Manage Data Platforms: Schedule and manage the data platform using Google Cloud Scheduler and Cloud Composer (Airflow), ensuring seamless data pipeline operations
  • Optimize Data Layer: Design and optimize the data layer for efficient data migration and data processing using Google Cloud services
  • Ensure Scalability: Ensure scalability and efficiency of data pipelines and data engineering solutions to meet business needs

Skills

  • Proven experience designing, building, and maintaining data engineering solutions on Google's Cloud ecosystem, including Google DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, CloudSQL, and AlloyDB
  • Experience with Apache Beam, Apache Airflow, dbt, Spark/Python, or Spark/Scala, and ability to integrate these technologies with Google Cloud services
  • Experience developing and managing batch and real-time data pipelines for Data Warehouse and Datalake using Google Cloud services
  • Experience scheduling and managing data platforms using Google Cloud Scheduler and Cloud Composer (Airflow)
  • Experience designing and optimizing data layers for efficient data migration and data processing using Google Cloud services
  • Experience with Apache Beam, including integrating it with Google Cloud services such as DataFlow, is highly valued
  • Ability to optimize Beam pipelines for scalability and efficiency is a plus
  • Familiarity with dbt and data modeling concepts, including data warehousing and data lake architecture, is beneficial for designing and optimizing data layers
  • Proficiency in Spark and Scala, including integrating them with Google Cloud services such as DataProc, is desirable for building and maintaining data engineering solutions

Benefits

  • This role can be performed from anywhere in the United States of America
  • Long-term career development support

Company Overview

  • IBM provides technology and consulting, including software, infrastructure systems, and cloud-based solutions. It was founded in 1911, and is headquartered in Armonk, New York, USA, with a workforce of 10001+ employees. Its website is

  • Company H1B Sponsorship

  • IBM has a track record of offering H1B sponsorships, with 1230 in 2026, 2857 in 2025, 3115 in 2024, 2047 in 2023, 1795 in 2022, 1153 in 2021, 2669 in 2020. Please note that this does not guarantee sponsorship for this specific role.

  • Back to blog

    Other Jobs To Apply

    Human Resources (HR) - Internship (WFH)

    Work From Home Creative Content Writer Job

    Odia (Oriya) Language Expert

    Remote Pinterest Pin Creator

    Remote Lead Medical Transcriptionist

    Dedicated Hygienist - Dental Jobs hiring

    Freelance Travel Consultant - Fresher (WFH)

    Scientific Copy Editor – Medicine & Life Sciences

    Remote Assistant Property Manager

    Genuine Packing Work From Home Jobs with Free Training Provided

    Credentialing Specialist (Medi-Cal, Anthem CA, Kaiser Experience Required)

    Remote Field Researcher

    New Relic Implementation Specialist

    Remote Typing Jobs: Data Entry from Home

    Learning Experience Architect (E Learning Specialist)

    Google Cloud Platform Internship with Certificate

    Online Tutor Jobs — Teach From Home, Flexible Schedule | Anand Tutorials

    Hiring part-time weekend Typing Job (WFH)

    Reservations Supervisor

    Freelance Medical Transcription Jobs - Flexible Hours

    Home Based Typing Jobs

    Remote Hospitality & Travel Support Agent

    Online Customer Support Agent – Entry-Level – Female College Students Preferred

    Remote Data Entry Clerk - Work at Home

    Administrative Assistant

    Customer Success for Digital Nomad Community (Fully Remote)

    Amazon Data Entry Jobs from home - No Experience Needed

    Ventilation Installation Engineer's Mate - Remote

    Customer Support Executive (CSE)

    AS & A Level Teacher GCSE, IB & IGCSE

    Student Marketing & Outreach Internship

    Student Marketing & Outreach Internship

    Hiring Now: reputed company Remote Careers From Home $27/Hr

    Finance Trainee || Freshers & Experienced

    Site Support & Safety Specialist

    Site Support & Safety Specialist

    [Remote] Pinterest Social Media Marketer Internship

    Administrative Assistant-EMEA & APJ

    Medical Transcriptionist

    Remote Pathology Transcriptionist

    Copy Editor - Science (WFH)

    Senior Software Engineer (Node.js & AWS)

    Senior Systems Administrator II Remote / Telecommute Jobs

    Campus Marketing Executive Intern

    Chat Agent - Remote - Flexible Schedule - No Phone Calls - $25-$35/hr

    Non Phone Digital Customer Support Assist Clients Online Without Phone Calls

    Relationship Manager_HOUSING FINANCE_0412_8087_1091164_HRR

    Client Controller

    Accounting Expert | Remote

    Remote BCBA

    Common Interview Questions And Answers

    1. HOW DO YOU PLAN YOUR DAY?

    This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

    2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

    When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

    3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

    Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

    4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

    With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

    5. HOW DO YOU PROCESS INFORMATION?

    Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

    6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

    Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

    7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

    Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

    8. HOW TO PRIORITIZE WORK?

    The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

    9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

    Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

    10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

    This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...