azure - How to use two file extensions as wildcard (*.csv or *.xml) in Azure data factory?
问题描述
I have a path in ADLS that has a range of different files including *.csv
and *.xml
(which is not true xml
, it's just a csv
with xml
extension).
I want to copy only *.csv
and *.xml
files from this path to another using copy activity in ADF. Right now I only can specify one of them as wildcard in the file name of copy activity and not both.
Is there any way to specify two wildcards, like for example, .csv or .xml
.
BTW, I might be able to use filter activity with get meta data, but this is too much if there is other ways. This documentation didn't help much too:
As I said, filtering won't work (without forEach), and that's not optimized:
解决方案
No, there isn't a way can specify two wildcards path.
According my experience, the easiest way is that you can create two copy active in one pipeline:
- Copy active1: copy the files end with
*.csv
. - Copy active2: copy the files end with
*.xml
.
For your another question,there are many ways can achieve it. You could add an if condition to filter the condition: only copy active 1 and 2 both true/succeeded:
推荐阅读
- angular - 在 Angular 中刷新页面。Socket.io 问题
- spring-boot - JUnit测试用例在使用时没有返回正确的值,然后返回条件
- amazon-web-services - 带有 docker hub 映像的 ECS FARGATE TASK 定义
- javascript - 检查本地文件是否已更改
- r - 带有表格 ggplot 编码的森林图
- c# - 如何在整个应用程序中创建和注入用户特定的单例类?
- c++ - 我正在尝试实现典型的最低成本路径问题。但是我无法处理给定的 Struct 类和 ENUM 类型我该如何处理?
- php - 在 PHP 中使用 domDocument 获取部分文本
- ios - react-native auth0 用苹果登录?
- python - 拟合统计分布 cdf 函数