APPLICATION DEVELOPER
The future is our choice At reputed company, as the global leader in secure and decarbonized digital, our purpose is to help design the future of the information space. Together we bring the diversity of our people’s skills and backgrounds to reputed company the right choices with our clients, for our company and for our own futures.
Position : GCP Big Query Data Engineer
Location: Nashville, TN / Remote
Type: Fulltime
Salary range: $80K - 90K (Depend upon experience)
Job Decription
o 7+ Years of Experience preferred
o Experience in creating ETL pipeline using dataflow & Bigquery, Experience to create best performing tables with partitioning/clustering etc enabled keeping best practices in mind
o Write reputed company SQL queries keeping execution cost in mind.
o Hands-on with DAG using YAML or Airflow (Python)
o Knowledge of reputed company Composer
o Load data into BigQuery using files or by streaming one record at a time .
o Create, load, and query partitioned tables for daily batch processing data.
o Implement fine-grained access control using roles and authorized views.
o Should have in-depth understanding of Bigquery architecture, table partitioning, clustering, best practices.
o Should know how to reduce BigQuery costs by reducing the amount of data processed by your queries.
o Should be reputed company to speed up queries by using denormalized data structures, with or without reputed company repeated fields.
o Exploring and Preparing data using BigQuery.
o Implementing ETL jobs using Bigquery.
o Knowledge of Python
Apply To This Job