teratail
回答率
85.37%
teratail 10th-anniversary
teratail 10th-anniversary
質問するログイン新規登録
トップに関する質問Embulkでバイナリのデータがコピーできない

編集履歴

質問編集履歴

6

追記

2021/06/15 17:03

投稿

koichi88
koichi88

スコア10

test CHANGED
File without changes
test CHANGED
@@ -134,6 +134,8 @@
134
134
 
135
135
 
136
136
 
137
+ ```
138
+
137
139
  in:
138
140
 
139
141
  type: mysql
@@ -173,3 +175,5 @@
173
175
  mode: replace
174
176
 
175
177
  after_load: insert into tableA(id,DATA) select id,FROM_BASE64(DATA) from tableA;
178
+
179
+ ```

5

追記

2021/06/15 17:03

投稿

koichi88
koichi88

スコア10

test CHANGED
File without changes
test CHANGED
@@ -125,3 +125,51 @@
125
125
  embulk-input-mysql 0.10.1
126
126
 
127
127
  embulk-output-mysql 0.8.7
128
+
129
+
130
+
131
+ 2021/06/16 追記
132
+
133
+ 下記のように修正し、embulkを実行したところ、エラーになりました。
134
+
135
+
136
+
137
+ in:
138
+
139
+ type: mysql
140
+
141
+ user: user
142
+
143
+ password: password
144
+
145
+ database: dbA
146
+
147
+ table: tableA
148
+
149
+ host: host
150
+
151
+ select: id,TO_BASE64(DATA) as DATA
152
+
153
+ out:
154
+
155
+ type: mysql
156
+
157
+ user: user
158
+
159
+ password: password
160
+
161
+ database: dbA
162
+
163
+ table: tableA
164
+
165
+ column_options:
166
+
167
+ DATA:
168
+
169
+ type: longtext
170
+
171
+ host: host
172
+
173
+ mode: replace
174
+
175
+ after_load: insert into tableA(id,DATA) select id,FROM_BASE64(DATA) from tableA;

4

追加

2021/06/15 17:02

投稿

koichi88
koichi88

スコア10

test CHANGED
File without changes
test CHANGED
@@ -18,7 +18,7 @@
18
18
 
19
19
  ```
20
20
 
21
- Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of '<column name>' column. Please add 'columnA: {value_type: string}' to 'column_options: {...}' option to convert the values to strings, or exclude the column from 'select:' option
21
+ Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of 'DATA' column. Please add 'columnA: {value_type: string}' to 'column_options: {...}' option to convert the values to strings, or exclude the column from 'select:' option
22
22
 
23
23
  ```
24
24
 
@@ -96,6 +96,32 @@
96
96
 
97
97
  column_options:
98
98
 
99
- columnA: {value_type: string}
99
+ DATA: {value_type: string}
100
100
 
101
101
  ```
102
+
103
+
104
+
105
+ ### テーブル定義
106
+
107
+ ID:INT
108
+
109
+ DATA:MEDIUMBLOB
110
+
111
+ CREATED_DATE:DATETIME
112
+
113
+ UPDATED_DATE:DATETIME
114
+
115
+
116
+
117
+
118
+
119
+ ### バージョンなど
120
+
121
+ Amazon linux2
122
+
123
+ Embulk v0.9.23
124
+
125
+ embulk-input-mysql 0.10.1
126
+
127
+ embulk-output-mysql 0.8.7

3

カラム修正

2021/06/14 13:45

投稿

koichi88
koichi88

スコア10

test CHANGED
File without changes
test CHANGED
@@ -4,7 +4,7 @@
4
4
 
5
5
  embulkでRDStoRDSでコピーをしたいのですが、バイナリデータがサポートされていていないようで、エラーになります。
6
6
 
7
- エラーメッセージの通り、<column name>: {value_type: string}を追加しても解消されませんでした。
7
+ エラーメッセージの通り、columnA: {value_type: string}を追加しても解消されませんでした。
8
8
 
9
9
 
10
10
 
@@ -18,7 +18,7 @@
18
18
 
19
19
  ```
20
20
 
21
- Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of '<column name>' column. Please add '<column name>: {value_type: string}' to 'column_options: {...}' option to convert the values to strings, or exclude the column from 'select:' option
21
+ Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of '<column name>' column. Please add 'columnA: {value_type: string}' to 'column_options: {...}' option to convert the values to strings, or exclude the column from 'select:' option
22
22
 
23
23
  ```
24
24
 

2

項目追加

2021/06/12 02:46

投稿

koichi88
koichi88

スコア10

test CHANGED
File without changes
test CHANGED
@@ -21,6 +21,10 @@
21
21
  Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of '<column name>' column. Please add '<column name>: {value_type: string}' to 'column_options: {...}' option to convert the values to strings, or exclude the column from 'select:' option
22
22
 
23
23
  ```
24
+
25
+
26
+
27
+ ### コード
24
28
 
25
29
 
26
30
 

1

コード追加

2021/06/12 02:45

投稿

koichi88
koichi88

スコア10

test CHANGED
File without changes
test CHANGED
@@ -21,3 +21,77 @@
21
21
  Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of '<column name>' column. Please add '<column name>: {value_type: string}' to 'column_options: {...}' option to convert the values to strings, or exclude the column from 'select:' option
22
22
 
23
23
  ```
24
+
25
+
26
+
27
+ _input.yml.liquid
28
+
29
+
30
+
31
+ ```
32
+
33
+ in:
34
+
35
+ type: mysql
36
+
37
+ host: {{ env.IN_MYSQL_HOST }}
38
+
39
+ user: {{ env.IN_MYSQL_USER }}
40
+
41
+ password: {{ env.IN_MYSQL_PASSWORD }}
42
+
43
+ database: dbA
44
+
45
+ select: "*"
46
+
47
+ options: {useLegacyDatetimeCode: false, serverTimezone: Asia/Tokyo}
48
+
49
+
50
+
51
+ ```
52
+
53
+
54
+
55
+ _output.yml.liquid
56
+
57
+
58
+
59
+ ```
60
+
61
+ out:
62
+
63
+ type: mysql
64
+
65
+ mode: replace
66
+
67
+ host: {{ env.OUT_MYSQL_HOST }}
68
+
69
+ user: {{ env.OUT_MYSQL_USER }}
70
+
71
+ password: {{ env.OUT_MYSQL_PASSWORD }}
72
+
73
+ database: dbA
74
+
75
+ select: "*"
76
+
77
+ ```
78
+
79
+
80
+
81
+ config.yml.liquid
82
+
83
+ ```
84
+
85
+ {% include 'input' %}
86
+
87
+ table: tableA
88
+
89
+ {% include 'output' %}
90
+
91
+ table: tableA
92
+
93
+ column_options:
94
+
95
+ columnA: {value_type: string}
96
+
97
+ ```