[Remote] Data Engineer-Data Platforms-Google - 1

Other Jobs To Apply

Note: The job is a remote job and is open to candidates in USA. IBM Consulting helps companies advance their hybrid cloud and AI journeys through collaboration, technology, and innovative solutions. The Data Engineer will design, build, maintain, and optimize scalable batch and real-time data pipelines and data engineering solutions using Google Cloud data platforms and open-source technologies.


Responsibilities

  • Design Data Pipelines: Design and develop batch and real-time data pipelines for Data Warehouse and Datalake using Google Cloud services such as DataProc, DataFlow, PubSub, BigQuery, and Big Table
  • Develop Data Engineering Solutions: Build and maintain data engineering solutions using Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, Google DataFlow with Apache Beam or Python, and other open-source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala
  • Manage Data Platforms: Schedule and manage the data platform using Google Cloud Scheduler and Cloud Composer (Airflow), ensuring seamless data pipeline operations
  • Optimize Data Layer: Design and optimize the data layer for efficient data migration and data processing using Google Cloud services
  • Ensure Scalability: Ensure scalability and efficiency of data pipelines and data engineering solutions to meet business needs

Skills

  • Proven experience designing, building, and maintaining data engineering solutions on Google's Cloud ecosystem, including Google DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, CloudSQL, and AlloyDB
  • Experience with Apache Beam, Apache Airflow, dbt, Spark/Python, or Spark/Scala, and ability to integrate these technologies with Google Cloud services
  • Experience developing and managing batch and real-time data pipelines for Data Warehouse and Datalake using Google Cloud services
  • Experience scheduling and managing data platforms using Google Cloud Scheduler and Cloud Composer (Airflow)
  • Experience designing and optimizing data layers for efficient data migration and data processing using Google Cloud services
  • Experience with Apache Beam, including integrating it with Google Cloud services such as DataFlow, is highly valued
  • Ability to optimize Beam pipelines for scalability and efficiency is a plus
  • Familiarity with dbt and data modeling concepts, including data warehousing and data lake architecture, is beneficial for designing and optimizing data layers
  • Proficiency in Spark and Scala, including integrating them with Google Cloud services such as DataProc, is desirable for building and maintaining data engineering solutions

Benefits

  • This role can be performed from anywhere in the United States of America
  • Long-term career development support

Company Overview

  • IBM provides technology and consulting, including software, infrastructure systems, and cloud-based solutions. It was founded in 1911, and is headquartered in Armonk, New York, USA, with a workforce of 10001+ employees. Its website is

  • Company H1B Sponsorship

  • IBM has a track record of offering H1B sponsorships, with 1230 in 2026, 2857 in 2025, 3115 in 2024, 2047 in 2023, 1795 in 2022, 1153 in 2021, 2669 in 2020. Please note that this does not guarantee sponsorship for this specific role.

  • Back to blog

    Other Jobs To Apply

    amazon work from home $15+/ Hour (Sign on Bonus!)!

    REMOTE Prior Authorization Pharmacy Technician

    IT SOC Analyst

    Clinical Practicum Intern Master''s Level

    External Warehouse Supervisor, G1

    Integrated Service Senior Specialist

    Call Center Agent (PT or FT - 100% Work From Home)

    Overnight Warehouse Associate-Sort & Reset(PT)-San Antonio,TX

    Data Entry Clerk Work From Home - Part-Time Focus Group Participants (Up To $750/Week)

    Remote Beginner Product Reviewer Mobile Apps (Flexible Hours)

    Remote Amazon Expert

    Warehouse Associate - $26/hr +

    100% Virtual - Urgent Care - Per Diem Opportunity

    Basic Data Entry Agent Work From Home – No Experience Needed

    Chiller Technician

    amazon work from home $15+/ Hour (Sign on Bonus!)!

    Freezer, Cooler and Deli Stocker Associate

    Call Center Remote Customer Service Representative

    Amazon Picker/Packer

    Data Entry Clerk Work From Home - Part-Time Focus Group Participants (Up To $750/Week)

    Earn 19 plus per Hour - (Remote) Customer Service Representative

    Remote Apple Jobs, Apple Jobs Remote, Apple At Home Jobs – Job ID- 528 Job ID- 2716

    Lead Control Management Officer - Information and Cyber Security, Identity and Access Management

    Remote Apple Jobs, Apple Jobs Remote, Apple At Home Jobs – Job ID- 528 Job ID- 2716

    Cybersecurity - Entry Level Training Program

    Lead Control Management Officer - Information and Cyber Security, Identity and Access Management

    [Remote] Marketing Representative Rental Program

    Cybersecurity - Entry Level Training Program

    Distribution Associate (Picking and Packing) - Hiring now!

    [Remote] Marketing Representative Rental Program

    Data Entry Clerk Work From Home - Part-Time Focus Group Participants (Up To $750/Week)

    Distribution Associate (Picking and Packing) - Hiring now!

    Remote Out of Office Position / Data Entry (Hiring Immediately)

    Data Entry Clerk Work From Home - Part-Time Focus Group Participants (Up To $750/Week)

    Remote Out of Office Position / Data Entry (Hiring Immediately)

    Program Manager, Relo Ops Excellence, Relo Ops Integration, RLOI

    Cybersecurity - Entry Level Training Program

    Hotel Front Desk Agent

    Warehouse Packer

    Part Time Customer Service Representative (Teleradiology Support)

    Support Job Remote Office Associate Amazon Work-from-Home Opportunity Job ID- 2712

    Amazon Customer Service - Work From Home $16-$24/hr

    Product Tester (Work From Home) – Keep Free Products + Weekly Pay

    Plans Examiner

    Music Audio Expert - Fully Remote | Upto $14/hr

    Flexible Part-Time Scanning & Data-Entry Specialist

    Ups Data Entry Work At Home Jobs - Apply Now

    Customer Care Representative- Work From Home in Kentucky

    Recruiter/Talent Acquisition Specialist – Remote (74)

    Delta Airlines Remote Customer Support - Work From Your Own Home

    Common Interview Questions And Answers

    1. HOW DO YOU PLAN YOUR DAY?

    This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

    2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

    When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

    3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

    Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

    4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

    With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

    5. HOW DO YOU PROCESS INFORMATION?

    Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

    6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

    Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

    7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

    Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

    8. HOW TO PRIORITIZE WORK?

    The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

    9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

    Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

    10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

    This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...