azure - Microsoft.DataTransfer.Common.Shared.HybridDeliveryException TypeName 不能为空

Question

我有一个数据工厂，可以将数据从 RESTful Web 服务复制到 Azure 数据仓库。我已经测试并预览了所有连接和数据集。
我收到以下错误消息。

{
    "errorCode": "2200",  
    "message":   "ErrorCode=InvalidParameter,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The value of the property 'typeName' is invalid: 'Value cannot be null.\r\nParameter name: typeName'.,Source=,''Type=System.ArgumentNullException,Message=Value cannot be null.\r\nParameter name: typeName,Source=Microsoft.DataTransfer.Common,'",
    "failureType": "UserError",  
    "target": "ImportLegs"  
}

管道源

{
    "name": "Import Trip Data",
    "properties": {
        "activities": [
            {
                "name": "ImportLegs",
                "type": "Copy",
                "policy": {
                    "timeout": "7.00:00:00",
                    "retry": 0,
                    "retryIntervalInSeconds": 30,
                    "secureOutput": false,
                    "secureInput": false
                },
                "userProperties": [
                    {
                        "name": "Source",
                        "value": "flightleg?StartDate=01/01/2018&EndDate=02/01/2018"
                    },
                    {
                        "name": "Destination",
                        "value": "[Trip].[Leg]"
                    }
                ],
                "typeProperties": {
                    "source": {
                        "type": "RestSource",
                        "httpRequestTimeout": "00:01:40",
                        "requestInterval": "00.00:00:00.010"
                    },
                    "sink": {
                        "type": "SqlDWSink",
                        "allowPolyBase": false,
                        "writeBatchSize": 10000
                    },
                    "enableStaging": false,
                    "enableSkipIncompatibleRow": true,
                    "translator": {
                        "type": "TabularTranslator",
                        "mappings": [
                            {
                                "source": {
                                    "path": "id"
                                },
                                "sink": {
                                    "name": "Origin"
                                }
                            },
                            {
                                "source": {
                                    "path": "actualArrivalDateLocal"
                                },
                                "sink": {
                                    "name": "Destination"
                                }
                            },
                            {
                                "source": {
                                    "path": "actualArrivalDateUTC"
                                },
                                "sink": {
                                    "name": "FlightLogDistance"
                                }
                            },
                            {
                                "source": {
                                    "path": "actualBlockTime"
                                },
                                "sink": {
                                    "name": "FlightLogFlightTime"
                                }
                            },
                            {
                                "source": {
                                    "path": "actualDepartureDateLocal"
                                },
                                "sink": {
                                    "name": "Aircraft"
                                }
                            },
                            {
                                "source": {
                                    "path": "actualDepartureDateUTC"
                                },
                                "sink": {
                                    "name": "ScheduledDepartDate"
                                }
                            }
                        ]
                    }
                },
                "inputs": [
                    {
                        "referenceName": "FlightLeg",
                        "type": "DatasetReference"
                    }
                ],
                "outputs": [
                    {
                        "referenceName": "TripLegDW",
                        "type": "DatasetReference"
                    }
                ]
            }
        ]
    },
    "type": "Microsoft.DataFactory/factories/pipelines"
}

标签： azureazure-data-factoryazure-data-factory-2azure-sql-data-warehouse

Answer 1

我也有同样的错误，经过一些研究，我找到了一些解决方案。发布以进一步帮助某人。

错误-

{
"errorCode": "2200",
"message": "ErrorCode=UserErrorFailedS3FileReadOperation,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The operation on file part-00000-.csv.gz under directory test-bucket/abc_backfill/abc_visits is failed due to exception. ,Source=Microsoft.DataTransfer.ClientLibrary.MultipartBinaryConnector,''Type=Amazon.S3.AmazonS3Exception,Message=Error making request with Error Code Forbidden and Http Status Code Forbidden. No further error information was returned by the service.,Source=AWSSDK.Core,''Type=Amazon.Runtime.Internal.HttpErrorResponseException,Message=The remote server returned an error: (403) Forbidden.,Source=AWSSDK.Core,''Type=System.Net.WebException,Message=The remote server returned an error: (403) Forbidden.,Source=System,'",
"failureType": "UserError",
"target": "Copy data1",
"details": []

}

解决方案 - 我发现这是一些访问问题。即使在测试连接时它也取得了成功，但是在执行管道时它却因上述消息而失败。我发现，我正在访问错误的目录。如上 abc_backfill 是具有 abc_visits 的根目录或共享目录，它给出了问题。

我发现我有另一个与 abc_testbackfill 共享的目录，它指向相同的 abc_visits。一旦我在数据集中更改为 abc_testbackfill。它开始工作了。所以我相信我无法访问 abc_backfill 共享并且我遇到了错误。