Google Bigquery

Posted 1 day 10 hours ago by HCL Technologies B.V. Netherland

Permanent
Not Specified
Other
Noord-Holland, Netherlands
Job Description

Job Role- Google Bigquery


Loation - Amsterdam, Nethelrands


Job Description:


Minimum qualifications:

Bachelor's degree in Computer Science, Engineering, Mathematics, a related field, or equivalent practical experience.

Experience in distributed data processing frameworks DBT, Dataforms and Dataproc Google Cloud Platform analytical and transactional data stores like BigQuery, CloudSQL, etc.

Experience in Google Cloud Platform.

Experience in one Database type to write SQLs.

Experience in working with/on data warehouses, including data warehouse technical architectures, infrastructure components, ETL/ELT and reporting/analytic tools, environments, and data structures.


Preferred qualifications:

Experience in developing and troubleshooting data processing algorithms and software using Python, Java, Scala, Spark and hadoop frameworks.

Experience with encryption techniques like symmetric, asymmetric, HSMs, and envelop, and ability to implement secure key storage using Key Management System.

Experience in building multi-tier, high availability applications with modern technologies such as NoSQL, MongoDB, SparkML, and TensorFlow.

Experience architecting, developing software, or internet scale production-grade Big Data solutions in virtualized environments.

Experience in Big Data, information retrieval, data mining, or Machine Learning.

Experience with IaC and CICD tools like Terraform, Ansible, Jenkins etc.


Responsibilities:


As a Data Engineer, you'll guide customers on how to ingest, store, process, analyze, and explore/visualize data on the Google Cloud Platform (GCP). You will work on data migrations and modernization projects, and with customers to design large-scale data processing systems, develop data pipelines optimized for scaling, and troubleshoot potential platform/product challenges. You will have an in-depth understanding of data governance and security controls. Additionally, you'll work closely with Product Management and Product Engineering teams to build and constantly drive excellence in our products.


Interact with stakeholders to translate customer requirements into recommendations for appropriate solution architectures and advisory services.

Engage with technical leads, and partners to lead high velocity migration and modernization to GCP.

Design, Migrate/Build and Operationalize data storage and processing infrastructure using Cloud native products.

Develop and implement data quality and governance procedures to ensure the accuracy and reliability of data.

Take various project requirements and organize them into clear goals and objectives, and create a work breakdown structure to manage internal and external stakeholders.