azure - Is there a way to setup a Snowpipe on multiple Azure Storage Accounts?
问题描述
My company set up multiple storage accounts (about 30) for an app with the same container name on the same Azure tenant ID (ex. azure://myaccount1.blob.core.windows.net/samecontainername, azure://myaccount2.blob.core.windows.net/samecontainername, azure://myaccount3.blob.core.windows.net/samecontainername)
I've created Snowpipes in the past and the process was:
- Create a queue on the account and container
- Create an Event Grid linked to that account and container and with a destination set as the created queue
- Create a Notification Integration in Snowflake (to a queue related to that account and container)
- Authenticate the service principal app Snowflake created (if it is the first time on that tenant ID)
- Create a stage using the account and blob url (azure://myaccount2.blob.core.windows.net/samecontainername) and using the notification integration created
- Create a pipe using the notification integration created and copy from the stage created into a variant table (for Json files)
The question is, is there a way to simplify this so I won't have to do the steps above 30 times? Each account contains the same container name
解决方案
Seems not as snowpipe can have one NOTIFICATION INTEGRATION per queue. However, we have setup a copy statement from all accounts into one not used for PROD on which we set up a NOTIFICATION INTEGRATION to Snowflake and then a PIPE using that integration
推荐阅读
- sum - DAX 公式比较行
- amazon-web-services - 在这种情况下我应该使用什么 aws 服务?
- android - 创建“左对齐”和“右对齐”HorizontalScrollViews/Recyclerviews
- javascript - Vuejs组件单击事件不起作用
- android - RecyclerView 为空时显示内容
- release-management - 配置更改的持续交付
- java - Java中的异常,根据类打印msg
- system-verilog - systemverilog - 单个语句中的多个增量运算符如何工作
- vector - Openlayers 4 矢量图
- c# - 如何阻止输入将先前的咨询发送到数据库