Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Implementa pipeline de dump de MongoDB #535

Open
wants to merge 21 commits into
base: master
Choose a base branch
from

Conversation

gabriel-milan
Copy link
Member

No description provided.

@gabriel-milan gabriel-milan requested a review from d116626 October 26, 2023 17:11
Copy link
Contributor

mergify bot commented Nov 13, 2023

@gabriel-milan esse pull request tem conflitos 😩

@mergify mergify bot added the conflict label Nov 13, 2023
@gabriel-milan gabriel-milan changed the title feat: add implementation for MongoDB [FEATURE] Implementa pipeline de dump de MongoDB Nov 24, 2023
Copy link

Análise da árvore de código

Os seguintes arquivos são afetados diretamente por alterações realizadas nesse pull request:
- pipelines/rj_setur/dbt_seeketing/schedules.py
- pipelines/rj_escritorio/dump_ftp_inea/tasks.py
- pipelines/rj_escritorio/waze/flows.py
- pipelines/rj_smtr/br_rj_riodejaneiro_onibus_gps/tasks.py
- pipelines/rj_segovi/dump_ftp_adm_processorio_sicop/tasks.py
- pipelines/rj_cor/meteorologia/meteorologia_inmet/tasks.py
- pipelines/utils/execute_dbt_model/utils.py
- pipelines/rj_cor/comando/eventos/flows.py
- pipelines/rj_iplanrio/sicop/flows.py
- pipelines/rj_smfp/dump_inadimplente/flows.py
- pipelines/rj_escritorio/data_catalog/utils.py
- pipelines/rj_smfp/dump_db_ergon/flows.py
- pipelines/utils/policy_matrix/flows.py
- pipelines/rj_escritorio/dump_url_seeketing/flows.py
- pipelines/rj_escritorio/cleanup/tasks.py
- pipelines/rj_smtr/materialize_to_datario/flows.py
- pipelines/rj_cetrio/dump_db_pit/schedules.py
- pipelines/rj_sme/dump_url_educacao_basica/schedules.py
- pipelines/rj_smfp/dump_db_ergon_comlurb/schedules.py
- pipelines/rj_cor/comando/eventos/tasks.py
- pipelines/rj_escritorio/bot_sistemas/tasks.py
- pipelines/rj_segovi/dump_ftp_adm_processorio_sicop/flows.py
- pipelines/rj_smfp/dump_db_sigma_compras_materiais/flows.py
- pipelines/rj_smfp/dump_url_metas/schedules.py
- pipelines/rj_escritorio/dump_url_turismo/schedules.py
- pipelines/utils/tasks.py
- pipelines/utils/dump_earth_engine_asset/flows.py
- pipelines/rj_escritorio/geolocator/flows.py
- pipelines/rj_rioaguas/saneamento_drenagem/nivel_lamina_agua/flows.py
- pipelines/rj_cor/meteorologia/precipitacao_websirene/flows.py
- pipelines/rj_pgm/dump_db_divida_ativa/schedules.py
- pipelines/rj_seconserva/dump_db_siscor/flows.py
- pipelines/rj_escritorio/dummy_predict/flows.py
- pipelines/utils/dump_db/utils.py
- pipelines/rj_pgm/dump_db_divida_ativa/flows.py
- pipelines/rj_sms/utils.py
- pipelines/rj_smfp/dump_db_sigma_compras_materiais/schedules.py
- pipelines/rj_escritorio/flooding_detection/tasks.py
- pipelines/rj_escritorio/flooding_detection/utils.py
- pipelines/rj_smtr/br_rj_riodejaneiro_bilhetagem/flows.py
- pipelines/rj_rioaguas/saneamento_drenagem/nivel_reservatorio/flows.py
- pipelines/rj_smtr/br_rj_riodejaneiro_sigmob/flows.py
- pipelines/rj_smfp/goals_dashboard_dbt/flows.py
- pipelines/rj_segovi/dump_db_1746/schedules.py
- pipelines/rj_setur/dump_url_seeketing/schedules.py
- pipelines/rj_smi/dbt_obras_dashboard/schedules.py
- pipelines/rj_setur/dbt_seeketing/flows.py
- pipelines/rj_smtr/br_rj_riodejaneiro_onibus_gps/flows.py
- pipelines/rj_escritorio/comunicacao_executiva_dbt/schedules.py
- pipelines/utils/georeference/flows.py
- pipelines/rj_smtr/veiculo/flows.py
- pipelines/rj_sms/dump_db_sivep/schedules.py
- pipelines/rj_escritorio/seconserva_buracos_refresh_data/schedules.py
- pipelines/utils/constants.py
- pipelines/utils/execute_dbt_model/flows.py
- pipelines/rj_smtr/br_rj_riodejaneiro_brt_gps/tasks.py
- pipelines/rj_smi/dbt_obras_dashboard/flows.py
- pipelines/rj_cor/bot_semaforo/tasks.py
- pipelines/rj_smtr/flows.py
- pipelines/rj_smfp/dump_db_ergon/schedules.py
- pipelines/utils/dump_mongo/mongo.py
- pipelines/rj_smfp/goals_dashboard_dbt/schedules.py
- pipelines/rj_iplanrio/processorio/flows.py
- pipelines/utils/execute_dbt_model/tasks.py
- pipelines/rj_cor/meteorologia/precipitacao_cemaden/tasks.py
- pipelines/rj_smtr/br_rj_riodejaneiro_rdo/tasks.py
- pipelines/rj_smtr/registros_ocr_rir/flows.py
- pipelines/rj_cor/meteorologia/meteorologia_inmet/flows.py
- pipelines/rj_escritorio/dados_mestres_dump_datario/schedules.py
- pipelines/rj_escritorio/tweets_flamengo/tasks.py
- pipelines/rj_smtr/br_rj_riodejaneiro_rdo/flows.py
- pipelines/rj_smtr/br_rj_riodejaneiro_sigmob/tasks.py
- pipelines/utils/dump_to_gcs/flows.py
- pipelines/utils/dump_db/tasks.py
- pipelines/utils/dump_db/flows.py
- pipelines/rj_sms/dump_api_prontuario_vitai/tasks.py
- pipelines/rj_smtr/br_rj_riodejaneiro_stpl_gps/flows.py
- pipelines/utils/backfill_flow/tasks.py
- pipelines/rj_escritorio/dump_policy_matrix/flows.py
- pipelines/rj_segovi/dump_url_adm_processorio_sicop/schedules.py
- pipelines/rj_escritorio/birthday_notification/tasks.py
- pipelines/rj_cor/meteorologia/precipitacao_alertario/flows.py
- pipelines/rj_escritorio/dump_url_seeketing/schedules.py
- pipelines/utils/dump_url/utils.py
- pipelines/rj_sms/dump_db_sivep/flows.py
- pipelines/utils/dump_to_gcs/tasks.py
- pipelines/utils/dump_url/flows.py
- pipelines/rj_segovi/dump_db_1746/flows.py
- pipelines/rj_sme/dump_db_educacao_basica/flows.py
- pipelines/rj_cor/meteorologia/meteorologia_redemet/tasks.py
- pipelines/rj_smfp/dump_url_metas/flows.py
- pipelines/utils/dump_datario/tasks.py
- pipelines/rj_cor/meteorologia/precipitacao_cemaden/flows.py
- pipelines/utils/utils.py
- pipelines/rj_escritorio/dump_url_turismo/flows.py
- pipelines/rj_seop/create_ee_asset/flows.py
- pipelines/rj_smtr/br_rj_riodejaneiro_gtfs/flows.py
- pipelines/rj_seop/dump_url_conservacao_ambiental/flows.py
- pipelines/rj_setur/dump_url_seeketing/flows.py
- pipelines/rj_cor/meteorologia/radar/precipitacao/flows.py
- pipelines/rj_smtr/utils.py
- pipelines/rj_escritorio/notify_flooding/tasks.py
- pipelines/rj_cor/comando/eventos/utils.py
- pipelines/rj_seconserva/dump_db_siscor/schedules.py
- pipelines/utils/georeference/tasks.py
- pipelines/utils/dump_datario/flows.py
- pipelines/rj_sme/dump_url_educacao_basica/flows.py
- pipelines/utils/dump_mongo/tasks.py
- pipelines/rj_smtr/br_rj_riodejaneiro_brt_gps/flows.py
- pipelines/rj_segovi/dump_url_adm_processorio_sicop/flows.py
- pipelines/utils/dump_mongo/init.py
- pipelines/rj_cetrio/dump_db_pit/flows.py
- pipelines/rj_smtr/materialize_to_datario/schedules.py
- pipelines/rj_rioaguas/saneamento_drenagem/nivel_lagoa/tasks.py
- pipelines/rj_escritorio/inea/tasks.py
- pipelines/rj_escritorio/rain_dashboard/tasks.py
- pipelines/rj_sme/dump_db_educacao_basica/schedules.py
- pipelines/rj_rioaguas/saneamento_drenagem/nivel_reservatorio/schedules.py
- pipelines/rj_smfp/dump_db_sigma/flows.py
- pipelines/utils/elasticsearch_metrics/utils.py
- pipelines/utils/custom.py
- pipelines/utils/dump_mongo/flows.py
- pipelines/rj_smtr/registros_ocr_rir/tasks.py
- pipelines/utils/dump_earth_engine_asset/tasks.py
- pipelines/utils/predict_flow/tasks.py
- pipelines/rj_cor/meteorologia/precipitacao_websirene/tasks.py
- pipelines/rj_escritorio/geolocator/tasks.py
- pipelines/rj_escritorio/data_catalog/tasks.py
- pipelines/rj_smfp/dump_db_metas/schedules.py
- pipelines/rj_smfp/dump_db_ergon_comlurb/flows.py
- pipelines/utils/whatsapp_bot/flows.py
- pipelines/rj_cor/meteorologia/precipitacao_alertario/tasks.py
- pipelines/rj_cor/meteorologia/utils.py
- pipelines/utils/init.py
- pipelines/rj_smtr/br_rj_riodejaneiro_stpl_gps/tasks.py
- pipelines/rj_smi/dump_db_siscob/flows.py
- pipelines/rj_cor/meteorologia/satelite/tasks.py
- pipelines/rj_smfp/dump_db_metas/flows.py
- pipelines/rj_cor/meteorologia/satelite/satellite_utils.py
- pipelines/utils/dump_db/db.py
- pipelines/rj_escritorio/logs/flows.py
- pipelines/rj_cor/meteorologia/radar/precipitacao/tasks.py
- pipelines/rj_sms/dump_ftp_cnes/tasks.py
- pipelines/utils/predict_flow/flows.py
- pipelines/rj_iplanrio/sicop/schedules.py
- pipelines/rj_smtr/veiculo/tasks.py
- pipelines/rj_smi/dump_db_siscob/schedules.py
- pipelines/rj_smtr/projeto_subsidio_sppo/flows.py
- pipelines/utils/whatsapp_bot/tasks.py
- pipelines/utils/backfill_flow/flows.py
- pipelines/utils/dump_url/tasks.py
- pipelines/rj_rioaguas/saneamento_drenagem/nivel_lagoa/flows.py
- pipelines/rj_cor/meteorologia/radar/precipitacao/src/predict_rain.py
- pipelines/rj_iplanrio/processorio/schedules.py
- pipelines/rj_smfp/dump_db_sigma/schedules.py
- pipelines/rj_cor/meteorologia/meteorologia_redemet/flows.py
- pipelines/rj_seop/dump_url_conservacao_ambiental/schedules.py
- pipelines/rj_cor/tasks.py
- pipelines/rj_smfp/dump_inadimplente/schedules.py
- pipelines/rj_smtr/tasks.py
- pipelines/rj_rioaguas/saneamento_drenagem/nivel_lamina_agua/tasks.py
- pipelines/rj_cor/meteorologia/satelite/flows.py

Os seguintes usuários devem ser avisados sobre a alteração:
- @d116626
- @gabriel-milan

Copy link
Contributor

mergify bot commented Dec 11, 2023

@gabriel-milan esse pull request tem conflitos 😩

@mergify mergify bot added the conflict label Dec 11, 2023
Copy link
Contributor

mergify bot commented Feb 5, 2024

@gabriel-milan esse pull request tem conflitos 😩

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant