teratail
回答率
85.30%
teratail header banner
teratail header banner
質問するログイン新規登録
トップに関する質問csvファイルをOracleDBへインサート時にjavaエラー発生

編集履歴

質問編集履歴

5

質問内容の更新

2018/11/26 00:58

投稿

raccoondog
raccoondog

スコア77

title CHANGED
File without changes
body CHANGED
@@ -3,47 +3,7 @@
3
3
 
4
4
  環境：windows7 , oracle 12c , embulk 0.9.8
5
5
 
6
- ※出力されたjavaエラー
7
- ```ここに言語を入力
8
- org.embulk.exec.PartialExecutionException: org.embulk.spi.DataException: Invalid record at line 185:
9
- at org.embulk.exec.BulkLoader$LoaderState.buildPartialExecuteException(BulkLoader.java:339)
10
- at org.embulk.exec.BulkLoader.doRun(BulkLoader.java:565)
11
- at org.embulk.exec.BulkLoader.access$000(BulkLoader.java:34)
12
- at org.embulk.exec.BulkLoader$1.run(BulkLoader.java:352)
13
- at org.embulk.exec.BulkLoader$1.run(BulkLoader.java:349)
14
- at org.embulk.spi.Exec.doWith(Exec.java:22)
15
- at org.embulk.exec.BulkLoader.run(BulkLoader.java:349)
16
- at org.embulk.EmbulkEmbed.run(EmbulkEmbed.java:161)
17
- at org.embulk.EmbulkRunner.runInternal(EmbulkRunner.java:292)
18
- at org.embulk.EmbulkRunner.run(EmbulkRunner.java:156)
19
- at org.embulk.cli.EmbulkRun.runSubcommand(EmbulkRun.java:436)
20
- at org.embulk.cli.EmbulkRun.run(EmbulkRun.java:91)
21
6
 
22
- Caused by: org.embulk.spi.DataException: Invalid record at line 185:
23
- at org.embulk.standards.CsvParserPlugin.run(CsvParserPlugin.java:363)
24
- at org.embulk.spi.FileInputRunner.run(FileInputRunner.java:140)
25
- at org.embulk.exec.LocalExecutorPlugin$ScatterExecutor.runInputTask(LocalExecutorPlugin.java:271)
26
- at org.embulk.exec.LocalExecutorPlugin$ScatterExecutor.access$000(LocalExecutorPlugin.java:196)
27
- at org.embulk.exec.LocalExecutorPlugin$ScatterExecutor$1.call(LocalExecutorPlugin.java:235)
28
- at org.embulk.exec.LocalExecutorPlugin$ScatterExecutor$1.call(LocalExecutorPlugin.java:232)
29
- at java.util.concurrent.FutureTask.run(Unknown Source)
30
- at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
31
-
32
- Caused by: org.embulk.standards.CsvParserPlugin$CsvRecordValidateException: java.lang.NumberFormatException: For input string:
33
- at org.embulk.standards.CsvParserPlugin$1.longColumn(CsvParserPlugin.java:280)
34
- at org.embulk.spi.Column.visit(Column.java:48)
35
- at org.embulk.spi.Schema.visitColumns(Schema.java:68)
36
- at org.embulk.standards.CsvParserPlugin.run(CsvParserPlugin.java:261)
37
- ... 9 more
38
- Caused by: java.lang.NumberFormatException: For input string:
39
- at java.lang.NumberFormatException.forInputString(Unknown Source)
40
- at java.lang.Long.parseLong(Unknown Source)
41
- at java.lang.Long.parseLong(Unknown Source)
42
- at org.embulk.standards.CsvParserPlugin$1.longColumn(CsvParserPlugin.java:277)
43
- ... 12 more
44
- Error: org.embulk.spi.DataException: Invalid record at line 185:
45
- ```
46
-
47
7
  ※検証用の業務データのため、エラー内容から出力されたデータ項目は除いています。
48
8
 
49
9
  embulk定義ファイル
@@ -171,4 +131,32 @@
171
131
  out: {type: oracle, host: ｘｘｘｘ, port: ｘｘｘ, database: ｘｘｘ, user: ｘｘｘ, password: ｘｘｘ,
172
132
  table: ｘｘｘｘ, mode: insert, insert_method: normal, driver_path: 'C:\Users\ｘｘｘ\Desktop\embulkDB\product\12.2.0\dbhome_1\jdbc\lib\ojdbc8.jar'}
173
133
 
134
+ ```
135
+
136
+
137
+ ※2018/11/26　現在のエラー
138
+ ```ここに言語を入力
139
+ org.embulk.exec.PartialExecutionException: org.jruby.exceptions.RaiseException: (Error) failed during waiting a Copy job, get_job(fluid-emissary-216806, embulk_copy_job_f19fafe0-795f-4b9d-a49d-35269a460a2f), errors:[{:reason=>"invalid", :message=>"Provided Schema does not match Table fluid-emissary-216806:embulk_test.T_RS_TRAN. Field ORDER_NO has changed type from FLOAT to INTEGER."}]
140
+ at org.embulk.exec.BulkLoader$LoaderState.buildPartialExecuteException(BulkLoader.java:339)
141
+ at org.embulk.exec.BulkLoader.doRun(BulkLoader.java:565)
142
+ at org.embulk.exec.BulkLoader.access$000(BulkLoader.java:34)
143
+ at org.embulk.exec.BulkLoader$1.run(BulkLoader.java:352)
144
+ at org.embulk.exec.BulkLoader$1.run(BulkLoader.java:349)
145
+ at org.embulk.spi.Exec.doWith(Exec.java:22)
146
+ at org.embulk.exec.BulkLoader.run(BulkLoader.java:349)
147
+ at org.embulk.EmbulkEmbed.run(EmbulkEmbed.java:161)
148
+ at org.embulk.EmbulkRunner.runInternal(EmbulkRunner.java:292)
149
+ at org.embulk.EmbulkRunner.run(EmbulkRunner.java:156)
150
+ at org.embulk.cli.EmbulkRun.runSubcommand(EmbulkRun.java:436)
151
+ at org.embulk.cli.EmbulkRun.run(EmbulkRun.java:91)
152
+ at org.embulk.cli.Main.main(Main.java:26)
153
+ Caused by: org.jruby.exceptions.RaiseException: (Error) failed during waiting a Copy job, get_job(fluid-emissary-216806, embulk_copy_job_f19fafe0-795f-4b9d-a49d-35269a460a2f), errors:[{:reason=>"invalid", :message=>"Provided Schema does not match Table fluid-emissary-216806:embulk_test.T_RS_TRAN. Field ORDER_NO has changed type from FLOAT to INTEGER."}]
154
+ at RUBY.wait_load(C:/Users/yazaki/.embulk/lib/gems/gems/embulk-output-bigquery-0.4.9/lib/embulk/output/bigquery/bigquery_client.rb:346)
155
+ at RUBY.block in copy(C:/Users/yazaki/.embulk/lib/gems/gems/embulk-output-bigquery-0.4.9/lib/embulk/output/bigquery/bigquery_client.rb:289)
156
+ at RUBY.with_job_retry(C:/Users/yazaki/.embulk/lib/gems/gems/embulk-output-bigquery-0.4.9/lib/embulk/output/bigquery/bigquery_client.rb:58)
157
+ at RUBY.copy(C:/Users/yazaki/.embulk/lib/gems/gems/embulk-output-bigquery-0.4.9/lib/embulk/output/bigquery/bigquery_client.rb:249)
158
+ at RUBY.transaction(C:/Users/yazaki/.embulk/lib/gems/gems/embulk-output-bigquery-0.4.9/lib/embulk/output/bigquery.rb:407)
159
+ at RUBY.transaction(uri:classloader:/gems/embulk-0.9.8-java/lib/embulk/output_plugin.rb:64)
160
+
161
+ Error: org.jruby.exceptions.RaiseException: (Error) failed during waiting a Copy job, get_job(fluid-emissary-216806, embulk_copy_job_f19fafe0-795f-4b9d-a49d-35269a460a2f), errors:[{:reason=>"invalid", :message=>"Provided Schema does not match Table fluid-emissary-216806:embulk_test.T_RS_TRAN. FieldORDER_NO has changed type from FLOAT to INTEGER."}]
174
162
  ```

4

質問内容の更新

2018/11/26 00:57

投稿

raccoondog
raccoondog

スコア77

title CHANGED
File without changes
body CHANGED
File without changes

3

状況更新

2018/11/21 07:03

投稿

raccoondog
raccoondog

スコア77

title CHANGED
File without changes
body CHANGED
@@ -44,4 +44,131 @@
44
44
  Error: org.embulk.spi.DataException: Invalid record at line 185:
45
45
  ```
46
46
 
47
- ※検証用の業務データのため、エラー内容から出力されたデータ項目は除いています。
47
+ ※検証用の業務データのため、エラー内容から出力されたデータ項目は除いています。
48
+
49
+ embulk定義ファイル
50
+ ```ここに言語を入力
51
+ インプット
52
+ in:
53
+ type: file
54
+ path_prefix: 'C:\Users\ｘｘｘ\Desktop\embulk\ｘｘｘｘ.csv'
55
+ parser:
56
+ type: csv
57
+ delimiter: ','
58
+ skip_header_line: false
59
+ stop_on_invalid_record: true
60
+ out:
61
+ type: oracle
62
+ host: ｘｘｘｘ
63
+ port: ｘｘｘ
64
+ database: ｘｘｘ
65
+ user: ｘｘｘ
66
+ password: ｘｘｘ
67
+ table: ｘｘｘ
68
+ mode: insert
69
+ insert_method: normal
70
+ driver_path: 'C:\Users\ｘｘｘ\Desktop\embulkDB\product\12.2.0\dbhome_1\jdbc\lib\ojdbc8.jar'
71
+
72
+ アウトプット
73
+ in:
74
+ type: file
75
+ path_prefix: C:\Users\ｘｘｘ\Desktop\embulk\ｘｘｘｘ.csv
76
+ parser:
77
+ type: csv
78
+ delimiter: ','
79
+ skip_header_line: false
80
+ stop_on_invalid_record: true
81
+ charset: UTF-8
82
+ newline: CRLF
83
+ quote: '"'
84
+ escape: '"'
85
+ trim_if_not_quoted: false
86
+ skip_header_lines: 1
87
+ allow_extra_columns: false
88
+ allow_optional_columns: false
89
+ columns:
90
+ - {name: ORDER_NO, type: long}
91
+ - {name: RS_TYPE, type: long}
92
+ - {name: FACTORY_CODE, type: long}
93
+ - {name: ORG_CODE, type: string}
94
+ - {name: TRAN_DATE, type: timestamp, format: '%Y/%m/%d'}
95
+ - {name: HINBAN, type: string}
96
+ - {name: QTY, type: long}
97
+ - {name: SLIP_NO, type: string}
98
+ - {name: ITEM_NO, type: string}
99
+ - {name: DIVISION_NO, type: long}
100
+ - {name: FROM_FACTORY_CODE, type: long}
101
+ - {name: FROM_ORG_CODE, type: string}
102
+ - {name: FROM_SUBINV_CODE, type: string}
103
+ - {name: FROM_VALUE_CODE, type: string}
104
+ - {name: FROM_OPERATOR_NAME, type: string}
105
+ - {name: TO_FACTORY_CODE, type: string}
106
+ - {name: TO_ORG_CODE, type: string}
107
+ - {name: TO_SUBINV_CODE, type: long}
108
+ - {name: TO_VALUE_CODE, type: long}
109
+ - {name: TO_OPERATOR_NAME, type: string}
110
+ - {name: SUB_SYSTEM_TYPE1, type: string}
111
+ - {name: CANCEL_FLAG, type: long}
112
+ - {name: ACT_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
113
+ - {name: WH_ACT_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
114
+ - {name: JOB_CODE, type: string}
115
+ - {name: UNIT_PRICE, type: string}
116
+ - {name: ERROR_STATUS, type: long}
117
+ - {name: DESCRIPTION, type: string}
118
+ - {name: LOCATION, type: string}
119
+ - {name: REVISION_NO, type: string}
120
+ - {name: OPE_CODE, type: string}
121
+ - {name: BOX_KIND, type: string}
122
+ - {name: DEMAND_NO, type: string}
123
+ - {name: SUB_NO, type: string}
124
+ - {name: TRAFFIC_NO, type: string}
125
+ - {name: IF_FLAG, type: long}
126
+ - {name: SELL_BUY_DATA_FLAG, type: long}
127
+ - {name: SOURCE_ORDER_NO, type: long}
128
+ - {name: FT_DEFINE_ID, type: long}
129
+ - {name: FROM_SELL_BUY_ID, type: string}
130
+ - {name: TO_SELL_BUY_ID, type: string}
131
+ - {name: CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
132
+ - {name: CREATED_BY, type: string}
133
+ - {name: LAST_UPDATE_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
134
+ - {name: LAST_UPDATED_BY, type: string}
135
+ - {name: UPDATE_REQUEST_ID, type: long}
136
+ - {name: TIME_STAMP, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
137
+ - {name: INV_UPDATE_FLAG, type: long}
138
+ - {name: ISSUE_SEQ, type: string}
139
+ - {name: SOUMEI_ID, type: long}
140
+ - {name: GCPCS_IF_FLAG, type: string}
141
+ - {name: GCPCS_IF_CREATION_DATE, type: string}
142
+ - {name: RECIEPT_CODE, type: string}
143
+ - {name: DELIV_BIN_NO, type: string}
144
+ - {name: DELIV_NO, type: string}
145
+ - {name: RECV_BIN_NO, type: string}
146
+ - {name: SUB_SYSTEM_TYPE2, type: string}
147
+ - {name: SHIP_DATE, type: timestamp, format: '%Y/%m/%d'}
148
+ - {name: C_NO, type: long}
149
+ - {name: T_NO, type: long}
150
+ - {name: RECV_OFFICE_CODE, type: long}
151
+ - {name: SR_IF_FLAG, type: long}
152
+ - {name: SR_IF_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
153
+ - {name: PS_IF_FLAG, type: long}
154
+ - {name: PS_IF_CREATION_DATE, type: timestamp, format: '%Y/%m/%d %H:%M:%S'}
155
+ - {name: CUSTOMER_CODE, type: long}
156
+ - {name: KS_TYPE, type: string}
157
+ - {name: SUPPLY_SECTION, type: string}
158
+ - {name: MANAGE_NO, type: string}
159
+ - {name: SEND_OFFICE_CODE, type: long}
160
+ - {name: SOUMEI_SLIP_NO, type: long}
161
+ - {name: SOUMEI_ITEM_NO, type: string}
162
+ - {name: PS_YAZAKI_HINBAN, type: long}
163
+ - {name: INVOICE_CASE_INFO_NO, type: string}
164
+ - {name: GYK_SITE_CODE, type: string}
165
+ - {name: CASE_NO, type: string}
166
+ - {name: CASE_SUB_NO, type: string}
167
+ - {name: FROM_LOCATION, type: string}
168
+ - {name: TO_LOCATION, type: string}
169
+ - {name: GYK_TRAN_TYPE, type: string}
170
+ - {name: INV_INFO_UPDATE_FLAG, type: string}
171
+ out: {type: oracle, host: ｘｘｘｘ, port: ｘｘｘ, database: ｘｘｘ, user: ｘｘｘ, password: ｘｘｘ,
172
+ table: ｘｘｘｘ, mode: insert, insert_method: normal, driver_path: 'C:\Users\ｘｘｘ\Desktop\embulkDB\product\12.2.0\dbhome_1\jdbc\lib\ojdbc8.jar'}
173
+
174
+ ```

2

質問内容の更新

2018/11/21 06:40

投稿

raccoondog
raccoondog

スコア77

title CHANGED
File without changes
body CHANGED
@@ -29,7 +29,7 @@
29
29
  at java.util.concurrent.FutureTask.run(Unknown Source)
30
30
  at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
31
31
 
32
- Caused by: org.embulk.standards.CsvParserPlugin$CsvRecordValidateException: java.lang.NumberFormatException: For input string: "7273243550M"
32
+ Caused by: org.embulk.standards.CsvParserPlugin$CsvRecordValidateException: java.lang.NumberFormatException: For input string:
33
33
  at org.embulk.standards.CsvParserPlugin$1.longColumn(CsvParserPlugin.java:280)
34
34
  at org.embulk.spi.Column.visit(Column.java:48)
35
35
  at org.embulk.spi.Schema.visitColumns(Schema.java:68)

1

質問更新

2018/11/21 06:31

投稿

raccoondog
raccoondog

スコア77

title CHANGED
File without changes
body CHANGED
@@ -1,6 +1,8 @@
1
1
  csvファイルのデータをOracleDBへバルクインサートを試みると失敗します。
2
2
  csvファイルは16万行、81列のファイルになります。
3
3
 
4
+ 環境：windows7 , oracle 12c , embulk 0.9.8
5
+
4
6
  ※出力されたjavaエラー
5
7
  ```ここに言語を入力
6
8
  org.embulk.exec.PartialExecutionException: org.embulk.spi.DataException: Invalid record at line 185: