質問編集履歴

5

質問内容の更新

2018/11/26 00:58

投稿

raccoondog
raccoondog

スコア77

test CHANGED
File without changes
test CHANGED
@@ -8,340 +8,316 @@
8
8
 
9
9
 
10
10
 
11
+
12
+
13
+ ※検証用の業務データのため、エラー内容から出力されたデータ項目は除いています。
14
+
15
+
16
+
11
- ※出力されたjavaエラー
17
+ embulk定義ファイル
12
18
 
13
19
  ```ここに言語を入力
14
20
 
15
- org.embulk.exec.PartialExecutionException: org.embulk.spi.DataException: Invalid record at line 185:
16
-
17
- at org.embulk.exec.BulkLoader$LoaderState.buildPartialExecuteException(BulkLoader.java:339)
18
-
19
- at org.embulk.exec.BulkLoader.doRun(BulkLoader.java:565)
20
-
21
- at org.embulk.exec.BulkLoader.access$000(BulkLoader.java:34)
22
-
23
- at org.embulk.exec.BulkLoader$1.run(BulkLoader.java:352)
24
-
25
- at org.embulk.exec.BulkLoader$1.run(BulkLoader.java:349)
26
-
27
- at org.embulk.spi.Exec.doWith(Exec.java:22)
28
-
29
- at org.embulk.exec.BulkLoader.run(BulkLoader.java:349)
30
-
31
- at org.embulk.EmbulkEmbed.run(EmbulkEmbed.java:161)
32
-
33
- at org.embulk.EmbulkRunner.runInternal(EmbulkRunner.java:292)
34
-
35
- at org.embulk.EmbulkRunner.run(EmbulkRunner.java:156)
36
-
37
- at org.embulk.cli.EmbulkRun.runSubcommand(EmbulkRun.java:436)
38
-
39
- at org.embulk.cli.EmbulkRun.run(EmbulkRun.java:91)
40
-
41
-
42
-
43
- Caused by: org.embulk.spi.DataException: Invalid record at line 185:
44
-
45
- at org.embulk.standards.CsvParserPlugin.run(CsvParserPlugin.java:363)
46
-
47
- at org.embulk.spi.FileInputRunner.run(FileInputRunner.java:140)
48
-
49
- at org.embulk.exec.LocalExecutorPlugin$ScatterExecutor.runInputTask(LocalExecutorPlugin.java:271)
50
-
51
- at org.embulk.exec.LocalExecutorPlugin$ScatterExecutor.access$000(LocalExecutorPlugin.java:196)
52
-
53
- at org.embulk.exec.LocalExecutorPlugin$ScatterExecutor$1.call(LocalExecutorPlugin.java:235)
54
-
55
- at org.embulk.exec.LocalExecutorPlugin$ScatterExecutor$1.call(LocalExecutorPlugin.java:232)
56
-
57
- at java.util.concurrent.FutureTask.run(Unknown Source)
58
-
59
- at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
60
-
61
-
62
-
63
- Caused by: org.embulk.standards.CsvParserPlugin$CsvRecordValidateException: java.lang.NumberFormatException: For input string:
64
-
65
- at org.embulk.standards.CsvParserPlugin$1.longColumn(CsvParserPlugin.java:280)
66
-
67
- at org.embulk.spi.Column.visit(Column.java:48)
68
-
69
- at org.embulk.spi.Schema.visitColumns(Schema.java:68)
70
-
71
- at org.embulk.standards.CsvParserPlugin.run(CsvParserPlugin.java:261)
72
-
73
- ... 9 more
74
-
75
- Caused by: java.lang.NumberFormatException: For input string:
76
-
77
- at java.lang.NumberFormatException.forInputString(Unknown Source)
78
-
79
- at java.lang.Long.parseLong(Unknown Source)
80
-
81
- at java.lang.Long.parseLong(Unknown Source)
82
-
83
- at org.embulk.standards.CsvParserPlugin$1.longColumn(CsvParserPlugin.java:277)
84
-
85
- ... 12 more
86
-
87
- Error: org.embulk.spi.DataException: Invalid record at line 185:
21
+ インプット
22
+
23
+ in:
24
+
25
+ type: file
26
+
27
+ path_prefix: 'C:\Users\xxx\Desktop\embulk\xxxx.csv'
28
+
29
+ parser:
30
+
31
+ type: csv
32
+
33
+ delimiter: ','
34
+
35
+ skip_header_line: false
36
+
37
+ stop_on_invalid_record: true
38
+
39
+ out:
40
+
41
+ type: oracle
42
+
43
+ host: xxxx
44
+
45
+ port: xxx
46
+
47
+ database: xxx
48
+
49
+ user: xxx
50
+
51
+ password: xxx
52
+
53
+ table: xxx
54
+
55
+ mode: insert
56
+
57
+ insert_method: normal
58
+
59
+ driver_path: 'C:\Users\xxx\Desktop\embulkDB\product\12.2.0\dbhome_1\jdbc\lib\ojdbc8.jar'
60
+
61
+
62
+
63
+ アウトプット
64
+
65
+ in:
66
+
67
+ type: file
68
+
69
+ path_prefix: C:\Users\xxx\Desktop\embulk\xxxx.csv
70
+
71
+ parser:
72
+
73
+ type: csv
74
+
75
+ delimiter: ','
76
+
77
+ skip_header_line: false
78
+
79
+ stop_on_invalid_record: true
80
+
81
+ charset: UTF-8
82
+
83
+ newline: CRLF
84
+
85
+ quote: '"'
86
+
87
+ escape: '"'
88
+
89
+ trim_if_not_quoted: false
90
+
91
+ skip_header_lines: 1
92
+
93
+ allow_extra_columns: false
94
+
95
+ allow_optional_columns: false
96
+
97
+ columns:
98
+
99
+ - {name: ORDER_NO, type: long}
100
+
101
+ - {name: RS_TYPE, type: long}
102
+
103
+ - {name: FACTORY_CODE, type: long}
104
+
105
+ - {name: ORG_CODE, type: string}
106
+
107
+ - {name: TRAN_DATE, type: timestamp, format: '%Y/%m/%d'}
108
+
109
+ - {name: HINBAN, type: string}
110
+
111
+ - {name: QTY, type: long}
112
+
113
+ - {name: SLIP_NO, type: string}
114
+
115
+ - {name: ITEM_NO, type: string}
116
+
117
+ - {name: DIVISION_NO, type: long}
118
+
119
+ - {name: FROM_FACTORY_CODE, type: long}
120
+
121
+ - {name: FROM_ORG_CODE, type: string}
122
+
123
+ - {name: FROM_SUBINV_CODE, type: string}
124
+
125
+ - {name: FROM_VALUE_CODE, type: string}
126
+
127
+ - {name: FROM_OPERATOR_NAME, type: string}
128
+
129
+ - {name: TO_FACTORY_CODE, type: string}
130
+
131
+ - {name: TO_ORG_CODE, type: string}
132
+
133
+ - {name: TO_SUBINV_CODE, type: long}
134
+
135
+ - {name: TO_VALUE_CODE, type: long}
136
+
137
+ - {name: TO_OPERATOR_NAME, type: string}
138
+
139
+ - {name: SUB_SYSTEM_TYPE1, type: string}
140
+
141
+ - {name: CANCEL_FLAG, type: long}
142
+
143
+ - {name: ACT_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
144
+
145
+ - {name: WH_ACT_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
146
+
147
+ - {name: JOB_CODE, type: string}
148
+
149
+ - {name: UNIT_PRICE, type: string}
150
+
151
+ - {name: ERROR_STATUS, type: long}
152
+
153
+ - {name: DESCRIPTION, type: string}
154
+
155
+ - {name: LOCATION, type: string}
156
+
157
+ - {name: REVISION_NO, type: string}
158
+
159
+ - {name: OPE_CODE, type: string}
160
+
161
+ - {name: BOX_KIND, type: string}
162
+
163
+ - {name: DEMAND_NO, type: string}
164
+
165
+ - {name: SUB_NO, type: string}
166
+
167
+ - {name: TRAFFIC_NO, type: string}
168
+
169
+ - {name: IF_FLAG, type: long}
170
+
171
+ - {name: SELL_BUY_DATA_FLAG, type: long}
172
+
173
+ - {name: SOURCE_ORDER_NO, type: long}
174
+
175
+ - {name: FT_DEFINE_ID, type: long}
176
+
177
+ - {name: FROM_SELL_BUY_ID, type: string}
178
+
179
+ - {name: TO_SELL_BUY_ID, type: string}
180
+
181
+ - {name: CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
182
+
183
+ - {name: CREATED_BY, type: string}
184
+
185
+ - {name: LAST_UPDATE_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
186
+
187
+ - {name: LAST_UPDATED_BY, type: string}
188
+
189
+ - {name: UPDATE_REQUEST_ID, type: long}
190
+
191
+ - {name: TIME_STAMP, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
192
+
193
+ - {name: INV_UPDATE_FLAG, type: long}
194
+
195
+ - {name: ISSUE_SEQ, type: string}
196
+
197
+ - {name: SOUMEI_ID, type: long}
198
+
199
+ - {name: GCPCS_IF_FLAG, type: string}
200
+
201
+ - {name: GCPCS_IF_CREATION_DATE, type: string}
202
+
203
+ - {name: RECIEPT_CODE, type: string}
204
+
205
+ - {name: DELIV_BIN_NO, type: string}
206
+
207
+ - {name: DELIV_NO, type: string}
208
+
209
+ - {name: RECV_BIN_NO, type: string}
210
+
211
+ - {name: SUB_SYSTEM_TYPE2, type: string}
212
+
213
+ - {name: SHIP_DATE, type: timestamp, format: '%Y/%m/%d'}
214
+
215
+ - {name: C_NO, type: long}
216
+
217
+ - {name: T_NO, type: long}
218
+
219
+ - {name: RECV_OFFICE_CODE, type: long}
220
+
221
+ - {name: SR_IF_FLAG, type: long}
222
+
223
+ - {name: SR_IF_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
224
+
225
+ - {name: PS_IF_FLAG, type: long}
226
+
227
+ - {name: PS_IF_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
228
+
229
+ - {name: CUSTOMER_CODE, type: long}
230
+
231
+ - {name: KS_TYPE, type: string}
232
+
233
+ - {name: SUPPLY_SECTION, type: string}
234
+
235
+ - {name: MANAGE_NO, type: string}
236
+
237
+ - {name: SEND_OFFICE_CODE, type: long}
238
+
239
+ - {name: SOUMEI_SLIP_NO, type: long}
240
+
241
+ - {name: SOUMEI_ITEM_NO, type: string}
242
+
243
+ - {name: PS_YAZAKI_HINBAN, type: long}
244
+
245
+ - {name: INVOICE_CASE_INFO_NO, type: string}
246
+
247
+ - {name: GYK_SITE_CODE, type: string}
248
+
249
+ - {name: CASE_NO, type: string}
250
+
251
+ - {name: CASE_SUB_NO, type: string}
252
+
253
+ - {name: FROM_LOCATION, type: string}
254
+
255
+ - {name: TO_LOCATION, type: string}
256
+
257
+ - {name: GYK_TRAN_TYPE, type: string}
258
+
259
+ - {name: INV_INFO_UPDATE_FLAG, type: string}
260
+
261
+ out: {type: oracle, host: xxxx, port: xxx, database: xxx, user: xxx, password: xxx,
262
+
263
+ table: xxxx, mode: insert, insert_method: normal, driver_path: 'C:\Users\xxx\Desktop\embulkDB\product\12.2.0\dbhome_1\jdbc\lib\ojdbc8.jar'}
264
+
265
+
88
266
 
89
267
  ```
90
268
 
91
269
 
92
270
 
271
+
272
+
93
- 検証用業務データのため、エラー内容から出力されたデータ項目は除いています。
273
+ 2018/11/26 現在のエラー
94
-
95
-
96
-
97
- embulk定義ファイル
98
274
 
99
275
  ```ここに言語を入力
100
276
 
101
- インプット
102
-
103
- in:
104
-
105
- type: file
106
-
107
- path_prefix: 'C:\Users\xxx\Desktop\embulk\xxxx.csv'
108
-
109
- parser:
110
-
111
- type: csv
112
-
113
- delimiter: ','
114
-
115
- skip_header_line: false
116
-
117
- stop_on_invalid_record: true
118
-
119
- out:
120
-
121
- type: oracle
122
-
123
- host: xxxx
124
-
125
- port: xxx
126
-
127
- database: xxx
128
-
129
- user: xxx
130
-
131
- password: xxx
132
-
133
- table: xxx
134
-
135
- mode: insert
136
-
137
- insert_method: normal
138
-
139
- driver_path: 'C:\Users\xxx\Desktop\embulkDB\product\12.2.0\dbhome_1\jdbc\lib\ojdbc8.jar'
140
-
141
-
142
-
143
- アウトプット
144
-
145
- in:
146
-
147
- type: file
148
-
149
- path_prefix: C:\Users\xxx\Desktop\embulk\xxxx.csv
150
-
151
- parser:
152
-
153
- type: csv
154
-
155
- delimiter: ','
156
-
157
- skip_header_line: false
158
-
159
- stop_on_invalid_record: true
160
-
161
- charset: UTF-8
162
-
163
- newline: CRLF
164
-
165
- quote: '"'
166
-
167
- escape: '"'
168
-
169
- trim_if_not_quoted: false
170
-
171
- skip_header_lines: 1
172
-
173
- allow_extra_columns: false
174
-
175
- allow_optional_columns: false
176
-
177
- columns:
178
-
179
- - {name: ORDER_NO, type: long}
180
-
181
- - {name: RS_TYPE, type: long}
182
-
183
- - {name: FACTORY_CODE, type: long}
184
-
185
- - {name: ORG_CODE, type: string}
186
-
187
- - {name: TRAN_DATE, type: timestamp, format: '%Y/%m/%d'}
188
-
189
- - {name: HINBAN, type: string}
190
-
191
- - {name: QTY, type: long}
192
-
193
- - {name: SLIP_NO, type: string}
194
-
195
- - {name: ITEM_NO, type: string}
196
-
197
- - {name: DIVISION_NO, type: long}
198
-
199
- - {name: FROM_FACTORY_CODE, type: long}
200
-
201
- - {name: FROM_ORG_CODE, type: string}
202
-
203
- - {name: FROM_SUBINV_CODE, type: string}
204
-
205
- - {name: FROM_VALUE_CODE, type: string}
206
-
207
- - {name: FROM_OPERATOR_NAME, type: string}
208
-
209
- - {name: TO_FACTORY_CODE, type: string}
210
-
211
- - {name: TO_ORG_CODE, type: string}
212
-
213
- - {name: TO_SUBINV_CODE, type: long}
214
-
215
- - {name: TO_VALUE_CODE, type: long}
216
-
217
- - {name: TO_OPERATOR_NAME, type: string}
218
-
219
- - {name: SUB_SYSTEM_TYPE1, type: string}
220
-
221
- - {name: CANCEL_FLAG, type: long}
222
-
223
- - {name: ACT_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
224
-
225
- - {name: WH_ACT_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
226
-
227
- - {name: JOB_CODE, type: string}
228
-
229
- - {name: UNIT_PRICE, type: string}
230
-
231
- - {name: ERROR_STATUS, type: long}
232
-
233
- - {name: DESCRIPTION, type: string}
234
-
235
- - {name: LOCATION, type: string}
236
-
237
- - {name: REVISION_NO, type: string}
238
-
239
- - {name: OPE_CODE, type: string}
240
-
241
- - {name: BOX_KIND, type: string}
242
-
243
- - {name: DEMAND_NO, type: string}
244
-
245
- - {name: SUB_NO, type: string}
246
-
247
- - {name: TRAFFIC_NO, type: string}
248
-
249
- - {name: IF_FLAG, type: long}
250
-
251
- - {name: SELL_BUY_DATA_FLAG, type: long}
252
-
253
- - {name: SOURCE_ORDER_NO, type: long}
254
-
255
- - {name: FT_DEFINE_ID, type: long}
256
-
257
- - {name: FROM_SELL_BUY_ID, type: string}
258
-
259
- - {name: TO_SELL_BUY_ID, type: string}
260
-
261
- - {name: CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
262
-
263
- - {name: CREATED_BY, type: string}
264
-
265
- - {name: LAST_UPDATE_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
266
-
267
- - {name: LAST_UPDATED_BY, type: string}
268
-
269
- - {name: UPDATE_REQUEST_ID, type: long}
270
-
271
- - {name: TIME_STAMP, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
272
-
273
- - {name: INV_UPDATE_FLAG, type: long}
274
-
275
- - {name: ISSUE_SEQ, type: string}
276
-
277
- - {name: SOUMEI_ID, type: long}
278
-
279
- - {name: GCPCS_IF_FLAG, type: string}
280
-
281
- - {name: GCPCS_IF_CREATION_DATE, type: string}
282
-
283
- - {name: RECIEPT_CODE, type: string}
284
-
285
- - {name: DELIV_BIN_NO, type: string}
286
-
287
- - {name: DELIV_NO, type: string}
288
-
289
- - {name: RECV_BIN_NO, type: string}
290
-
291
- - {name: SUB_SYSTEM_TYPE2, type: string}
292
-
293
- - {name: SHIP_DATE, type: timestamp, format: '%Y/%m/%d'}
294
-
295
- - {name: C_NO, type: long}
296
-
297
- - {name: T_NO, type: long}
298
-
299
- - {name: RECV_OFFICE_CODE, type: long}
300
-
301
- - {name: SR_IF_FLAG, type: long}
302
-
303
- - {name: SR_IF_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
304
-
305
- - {name: PS_IF_FLAG, type: long}
306
-
307
- - {name: PS_IF_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
308
-
309
- - {name: CUSTOMER_CODE, type: long}
310
-
311
- - {name: KS_TYPE, type: string}
312
-
313
- - {name: SUPPLY_SECTION, type: string}
314
-
315
- - {name: MANAGE_NO, type: string}
316
-
317
- - {name: SEND_OFFICE_CODE, type: long}
318
-
319
- - {name: SOUMEI_SLIP_NO, type: long}
320
-
321
- - {name: SOUMEI_ITEM_NO, type: string}
322
-
323
- - {name: PS_YAZAKI_HINBAN, type: long}
324
-
325
- - {name: INVOICE_CASE_INFO_NO, type: string}
326
-
327
- - {name: GYK_SITE_CODE, type: string}
328
-
329
- - {name: CASE_NO, type: string}
330
-
331
- - {name: CASE_SUB_NO, type: string}
332
-
333
- - {name: FROM_LOCATION, type: string}
334
-
335
- - {name: TO_LOCATION, type: string}
336
-
337
- - {name: GYK_TRAN_TYPE, type: string}
338
-
339
- - {name: INV_INFO_UPDATE_FLAG, type: string}
340
-
341
- out: {type: oracle, host: xxxx, port: xxx, database: xxx, user: xxx, password: xxx,
342
-
343
- table: xxxx, mode: insert, insert_method: normal, driver_path: 'C:\Users\xxx\Desktop\embulkDB\product\12.2.0\dbhome_1\jdbc\lib\ojdbc8.jar'}
344
-
345
-
277
+ org.embulk.exec.PartialExecutionException: org.jruby.exceptions.RaiseException: (Error) failed during waiting a Copy job, get_job(fluid-emissary-216806, embulk_copy_job_f19fafe0-795f-4b9d-a49d-35269a460a2f), errors:[{:reason=>"invalid", :message=>"Provided Schema does not match Table fluid-emissary-216806:embulk_test.T_RS_TRAN. Field ORDER_NO has changed type from FLOAT to INTEGER."}]
278
+
279
+ at org.embulk.exec.BulkLoader$LoaderState.buildPartialExecuteException(BulkLoader.java:339)
280
+
281
+ at org.embulk.exec.BulkLoader.doRun(BulkLoader.java:565)
282
+
283
+ at org.embulk.exec.BulkLoader.access$000(BulkLoader.java:34)
284
+
285
+ at org.embulk.exec.BulkLoader$1.run(BulkLoader.java:352)
286
+
287
+ at org.embulk.exec.BulkLoader$1.run(BulkLoader.java:349)
288
+
289
+ at org.embulk.spi.Exec.doWith(Exec.java:22)
290
+
291
+ at org.embulk.exec.BulkLoader.run(BulkLoader.java:349)
292
+
293
+ at org.embulk.EmbulkEmbed.run(EmbulkEmbed.java:161)
294
+
295
+ at org.embulk.EmbulkRunner.runInternal(EmbulkRunner.java:292)
296
+
297
+ at org.embulk.EmbulkRunner.run(EmbulkRunner.java:156)
298
+
299
+ at org.embulk.cli.EmbulkRun.runSubcommand(EmbulkRun.java:436)
300
+
301
+ at org.embulk.cli.EmbulkRun.run(EmbulkRun.java:91)
302
+
303
+ at org.embulk.cli.Main.main(Main.java:26)
304
+
305
+ Caused by: org.jruby.exceptions.RaiseException: (Error) failed during waiting a Copy job, get_job(fluid-emissary-216806, embulk_copy_job_f19fafe0-795f-4b9d-a49d-35269a460a2f), errors:[{:reason=>"invalid", :message=>"Provided Schema does not match Table fluid-emissary-216806:embulk_test.T_RS_TRAN. Field ORDER_NO has changed type from FLOAT to INTEGER."}]
306
+
307
+ at RUBY.wait_load(C:/Users/yazaki/.embulk/lib/gems/gems/embulk-output-bigquery-0.4.9/lib/embulk/output/bigquery/bigquery_client.rb:346)
308
+
309
+ at RUBY.block in copy(C:/Users/yazaki/.embulk/lib/gems/gems/embulk-output-bigquery-0.4.9/lib/embulk/output/bigquery/bigquery_client.rb:289)
310
+
311
+ at RUBY.with_job_retry(C:/Users/yazaki/.embulk/lib/gems/gems/embulk-output-bigquery-0.4.9/lib/embulk/output/bigquery/bigquery_client.rb:58)
312
+
313
+ at RUBY.copy(C:/Users/yazaki/.embulk/lib/gems/gems/embulk-output-bigquery-0.4.9/lib/embulk/output/bigquery/bigquery_client.rb:249)
314
+
315
+ at RUBY.transaction(C:/Users/yazaki/.embulk/lib/gems/gems/embulk-output-bigquery-0.4.9/lib/embulk/output/bigquery.rb:407)
316
+
317
+ at RUBY.transaction(uri:classloader:/gems/embulk-0.9.8-java/lib/embulk/output_plugin.rb:64)
318
+
319
+
320
+
321
+ Error: org.jruby.exceptions.RaiseException: (Error) failed during waiting a Copy job, get_job(fluid-emissary-216806, embulk_copy_job_f19fafe0-795f-4b9d-a49d-35269a460a2f), errors:[{:reason=>"invalid", :message=>"Provided Schema does not match Table fluid-emissary-216806:embulk_test.T_RS_TRAN. FieldORDER_NO has changed type from FLOAT to INTEGER."}]
346
322
 
347
323
  ```

4

質問内容の更新

2018/11/26 00:57

投稿

raccoondog
raccoondog

スコア77

test CHANGED
File without changes
test CHANGED
File without changes

3

状況更新

2018/11/21 07:03

投稿

raccoondog
raccoondog

スコア77

test CHANGED
File without changes
test CHANGED
@@ -91,3 +91,257 @@
91
91
 
92
92
 
93
93
  ※検証用の業務データのため、エラー内容から出力されたデータ項目は除いています。
94
+
95
+
96
+
97
+ embulk定義ファイル
98
+
99
+ ```ここに言語を入力
100
+
101
+ インプット
102
+
103
+ in:
104
+
105
+ type: file
106
+
107
+ path_prefix: 'C:\Users\xxx\Desktop\embulk\xxxx.csv'
108
+
109
+ parser:
110
+
111
+ type: csv
112
+
113
+ delimiter: ','
114
+
115
+ skip_header_line: false
116
+
117
+ stop_on_invalid_record: true
118
+
119
+ out:
120
+
121
+ type: oracle
122
+
123
+ host: xxxx
124
+
125
+ port: xxx
126
+
127
+ database: xxx
128
+
129
+ user: xxx
130
+
131
+ password: xxx
132
+
133
+ table: xxx
134
+
135
+ mode: insert
136
+
137
+ insert_method: normal
138
+
139
+ driver_path: 'C:\Users\xxx\Desktop\embulkDB\product\12.2.0\dbhome_1\jdbc\lib\ojdbc8.jar'
140
+
141
+
142
+
143
+ アウトプット
144
+
145
+ in:
146
+
147
+ type: file
148
+
149
+ path_prefix: C:\Users\xxx\Desktop\embulk\xxxx.csv
150
+
151
+ parser:
152
+
153
+ type: csv
154
+
155
+ delimiter: ','
156
+
157
+ skip_header_line: false
158
+
159
+ stop_on_invalid_record: true
160
+
161
+ charset: UTF-8
162
+
163
+ newline: CRLF
164
+
165
+ quote: '"'
166
+
167
+ escape: '"'
168
+
169
+ trim_if_not_quoted: false
170
+
171
+ skip_header_lines: 1
172
+
173
+ allow_extra_columns: false
174
+
175
+ allow_optional_columns: false
176
+
177
+ columns:
178
+
179
+ - {name: ORDER_NO, type: long}
180
+
181
+ - {name: RS_TYPE, type: long}
182
+
183
+ - {name: FACTORY_CODE, type: long}
184
+
185
+ - {name: ORG_CODE, type: string}
186
+
187
+ - {name: TRAN_DATE, type: timestamp, format: '%Y/%m/%d'}
188
+
189
+ - {name: HINBAN, type: string}
190
+
191
+ - {name: QTY, type: long}
192
+
193
+ - {name: SLIP_NO, type: string}
194
+
195
+ - {name: ITEM_NO, type: string}
196
+
197
+ - {name: DIVISION_NO, type: long}
198
+
199
+ - {name: FROM_FACTORY_CODE, type: long}
200
+
201
+ - {name: FROM_ORG_CODE, type: string}
202
+
203
+ - {name: FROM_SUBINV_CODE, type: string}
204
+
205
+ - {name: FROM_VALUE_CODE, type: string}
206
+
207
+ - {name: FROM_OPERATOR_NAME, type: string}
208
+
209
+ - {name: TO_FACTORY_CODE, type: string}
210
+
211
+ - {name: TO_ORG_CODE, type: string}
212
+
213
+ - {name: TO_SUBINV_CODE, type: long}
214
+
215
+ - {name: TO_VALUE_CODE, type: long}
216
+
217
+ - {name: TO_OPERATOR_NAME, type: string}
218
+
219
+ - {name: SUB_SYSTEM_TYPE1, type: string}
220
+
221
+ - {name: CANCEL_FLAG, type: long}
222
+
223
+ - {name: ACT_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
224
+
225
+ - {name: WH_ACT_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
226
+
227
+ - {name: JOB_CODE, type: string}
228
+
229
+ - {name: UNIT_PRICE, type: string}
230
+
231
+ - {name: ERROR_STATUS, type: long}
232
+
233
+ - {name: DESCRIPTION, type: string}
234
+
235
+ - {name: LOCATION, type: string}
236
+
237
+ - {name: REVISION_NO, type: string}
238
+
239
+ - {name: OPE_CODE, type: string}
240
+
241
+ - {name: BOX_KIND, type: string}
242
+
243
+ - {name: DEMAND_NO, type: string}
244
+
245
+ - {name: SUB_NO, type: string}
246
+
247
+ - {name: TRAFFIC_NO, type: string}
248
+
249
+ - {name: IF_FLAG, type: long}
250
+
251
+ - {name: SELL_BUY_DATA_FLAG, type: long}
252
+
253
+ - {name: SOURCE_ORDER_NO, type: long}
254
+
255
+ - {name: FT_DEFINE_ID, type: long}
256
+
257
+ - {name: FROM_SELL_BUY_ID, type: string}
258
+
259
+ - {name: TO_SELL_BUY_ID, type: string}
260
+
261
+ - {name: CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
262
+
263
+ - {name: CREATED_BY, type: string}
264
+
265
+ - {name: LAST_UPDATE_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
266
+
267
+ - {name: LAST_UPDATED_BY, type: string}
268
+
269
+ - {name: UPDATE_REQUEST_ID, type: long}
270
+
271
+ - {name: TIME_STAMP, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
272
+
273
+ - {name: INV_UPDATE_FLAG, type: long}
274
+
275
+ - {name: ISSUE_SEQ, type: string}
276
+
277
+ - {name: SOUMEI_ID, type: long}
278
+
279
+ - {name: GCPCS_IF_FLAG, type: string}
280
+
281
+ - {name: GCPCS_IF_CREATION_DATE, type: string}
282
+
283
+ - {name: RECIEPT_CODE, type: string}
284
+
285
+ - {name: DELIV_BIN_NO, type: string}
286
+
287
+ - {name: DELIV_NO, type: string}
288
+
289
+ - {name: RECV_BIN_NO, type: string}
290
+
291
+ - {name: SUB_SYSTEM_TYPE2, type: string}
292
+
293
+ - {name: SHIP_DATE, type: timestamp, format: '%Y/%m/%d'}
294
+
295
+ - {name: C_NO, type: long}
296
+
297
+ - {name: T_NO, type: long}
298
+
299
+ - {name: RECV_OFFICE_CODE, type: long}
300
+
301
+ - {name: SR_IF_FLAG, type: long}
302
+
303
+ - {name: SR_IF_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
304
+
305
+ - {name: PS_IF_FLAG, type: long}
306
+
307
+ - {name: PS_IF_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
308
+
309
+ - {name: CUSTOMER_CODE, type: long}
310
+
311
+ - {name: KS_TYPE, type: string}
312
+
313
+ - {name: SUPPLY_SECTION, type: string}
314
+
315
+ - {name: MANAGE_NO, type: string}
316
+
317
+ - {name: SEND_OFFICE_CODE, type: long}
318
+
319
+ - {name: SOUMEI_SLIP_NO, type: long}
320
+
321
+ - {name: SOUMEI_ITEM_NO, type: string}
322
+
323
+ - {name: PS_YAZAKI_HINBAN, type: long}
324
+
325
+ - {name: INVOICE_CASE_INFO_NO, type: string}
326
+
327
+ - {name: GYK_SITE_CODE, type: string}
328
+
329
+ - {name: CASE_NO, type: string}
330
+
331
+ - {name: CASE_SUB_NO, type: string}
332
+
333
+ - {name: FROM_LOCATION, type: string}
334
+
335
+ - {name: TO_LOCATION, type: string}
336
+
337
+ - {name: GYK_TRAN_TYPE, type: string}
338
+
339
+ - {name: INV_INFO_UPDATE_FLAG, type: string}
340
+
341
+ out: {type: oracle, host: xxxx, port: xxx, database: xxx, user: xxx, password: xxx,
342
+
343
+ table: xxxx, mode: insert, insert_method: normal, driver_path: 'C:\Users\xxx\Desktop\embulkDB\product\12.2.0\dbhome_1\jdbc\lib\ojdbc8.jar'}
344
+
345
+
346
+
347
+ ```

2

質問内容の更新

2018/11/21 06:40

投稿

raccoondog
raccoondog

スコア77

test CHANGED
File without changes
test CHANGED
@@ -60,7 +60,7 @@
60
60
 
61
61
 
62
62
 
63
- Caused by: org.embulk.standards.CsvParserPlugin$CsvRecordValidateException: java.lang.NumberFormatException: For input string: "7273243550M"
63
+ Caused by: org.embulk.standards.CsvParserPlugin$CsvRecordValidateException: java.lang.NumberFormatException: For input string:
64
64
 
65
65
  at org.embulk.standards.CsvParserPlugin$1.longColumn(CsvParserPlugin.java:280)
66
66
 

1

質問更新

2018/11/21 06:31

投稿

raccoondog
raccoondog

スコア77

test CHANGED
File without changes
test CHANGED
@@ -1,6 +1,10 @@
1
1
  csvファイルのデータをOracleDBへバルクインサートを試みると失敗します。
2
2
 
3
3
  csvファイルは16万行、81列のファイルになります。
4
+
5
+
6
+
7
+ 環境:windows7 , oracle 12c , embulk 0.9.8
4
8
 
5
9
 
6
10