質問編集履歴
6
追記
title
CHANGED
|
File without changes
|
body
CHANGED
|
@@ -66,6 +66,7 @@
|
|
|
66
66
|
2021/06/16 追記
|
|
67
67
|
下記のように修正し、embulkを実行したところ、エラーになりました。
|
|
68
68
|
|
|
69
|
+
```
|
|
69
70
|
in:
|
|
70
71
|
type: mysql
|
|
71
72
|
user: user
|
|
@@ -85,4 +86,5 @@
|
|
|
85
86
|
type: longtext
|
|
86
87
|
host: host
|
|
87
88
|
mode: replace
|
|
88
|
-
after_load: insert into tableA(id,DATA) select id,FROM_BASE64(DATA) from tableA;
|
|
89
|
+
after_load: insert into tableA(id,DATA) select id,FROM_BASE64(DATA) from tableA;
|
|
90
|
+
```
|
5
追記
title
CHANGED
|
File without changes
|
body
CHANGED
|
@@ -61,4 +61,28 @@
|
|
|
61
61
|
Amazon linux2
|
|
62
62
|
Embulk v0.9.23
|
|
63
63
|
embulk-input-mysql 0.10.1
|
|
64
|
-
embulk-output-mysql 0.8.7
|
|
64
|
+
embulk-output-mysql 0.8.7
|
|
65
|
+
|
|
66
|
+
2021/06/16 追記
|
|
67
|
+
下記のように修正し、embulkを実行したところ、エラーになりました。
|
|
68
|
+
|
|
69
|
+
in:
|
|
70
|
+
type: mysql
|
|
71
|
+
user: user
|
|
72
|
+
password: password
|
|
73
|
+
database: dbA
|
|
74
|
+
table: tableA
|
|
75
|
+
host: host
|
|
76
|
+
select: id,TO_BASE64(DATA) as DATA
|
|
77
|
+
out:
|
|
78
|
+
type: mysql
|
|
79
|
+
user: user
|
|
80
|
+
password: password
|
|
81
|
+
database: dbA
|
|
82
|
+
table: tableA
|
|
83
|
+
column_options:
|
|
84
|
+
DATA:
|
|
85
|
+
type: longtext
|
|
86
|
+
host: host
|
|
87
|
+
mode: replace
|
|
88
|
+
after_load: insert into tableA(id,DATA) select id,FROM_BASE64(DATA) from tableA;
|
4
追加
title
CHANGED
|
File without changes
|
body
CHANGED
|
@@ -8,7 +8,7 @@
|
|
|
8
8
|
### 発生している問題・エラーメッセージ
|
|
9
9
|
|
|
10
10
|
```
|
|
11
|
-
Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of '
|
|
11
|
+
Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of 'DATA' column. Please add 'columnA: {value_type: string}' to 'column_options: {...}' option to convert the values to strings, or exclude the column from 'select:' option
|
|
12
12
|
```
|
|
13
13
|
|
|
14
14
|
### コード
|
|
@@ -47,5 +47,18 @@
|
|
|
47
47
|
{% include 'output' %}
|
|
48
48
|
table: tableA
|
|
49
49
|
column_options:
|
|
50
|
-
|
|
50
|
+
DATA: {value_type: string}
|
|
51
|
-
```
|
|
51
|
+
```
|
|
52
|
+
|
|
53
|
+
### テーブル定義
|
|
54
|
+
ID:INT
|
|
55
|
+
DATA:MEDIUMBLOB
|
|
56
|
+
CREATED_DATE:DATETIME
|
|
57
|
+
UPDATED_DATE:DATETIME
|
|
58
|
+
|
|
59
|
+
|
|
60
|
+
### バージョンなど
|
|
61
|
+
Amazon linux2
|
|
62
|
+
Embulk v0.9.23
|
|
63
|
+
embulk-input-mysql 0.10.1
|
|
64
|
+
embulk-output-mysql 0.8.7
|
3
カラム修正
title
CHANGED
|
File without changes
|
body
CHANGED
|
@@ -1,14 +1,14 @@
|
|
|
1
1
|
### 前提・実現したいこと
|
|
2
2
|
|
|
3
3
|
embulkでRDStoRDSでコピーをしたいのですが、バイナリデータがサポートされていていないようで、エラーになります。
|
|
4
|
-
エラーメッセージの通り、
|
|
4
|
+
エラーメッセージの通り、columnA: {value_type: string}を追加しても解消されませんでした。
|
|
5
5
|
|
|
6
6
|
何か回避方法をご存知であれば、教えて頂けると助かります。。
|
|
7
7
|
|
|
8
8
|
### 発生している問題・エラーメッセージ
|
|
9
9
|
|
|
10
10
|
```
|
|
11
|
-
Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of '<column name>' column. Please add '
|
|
11
|
+
Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of '<column name>' column. Please add 'columnA: {value_type: string}' to 'column_options: {...}' option to convert the values to strings, or exclude the column from 'select:' option
|
|
12
12
|
```
|
|
13
13
|
|
|
14
14
|
### コード
|
2
項目追加
title
CHANGED
|
File without changes
|
body
CHANGED
|
@@ -11,6 +11,8 @@
|
|
|
11
11
|
Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of '<column name>' column. Please add '<column name>: {value_type: string}' to 'column_options: {...}' option to convert the values to strings, or exclude the column from 'select:' option
|
|
12
12
|
```
|
|
13
13
|
|
|
14
|
+
### コード
|
|
15
|
+
|
|
14
16
|
_input.yml.liquid
|
|
15
17
|
|
|
16
18
|
```
|
1
コード追加
title
CHANGED
|
File without changes
|
body
CHANGED
|
@@ -9,4 +9,41 @@
|
|
|
9
9
|
|
|
10
10
|
```
|
|
11
11
|
Caused by: java.lang.UnsupportedOperationException: Unsupported type MEDIUMBLOB (sqlType=-4) of '<column name>' column. Please add '<column name>: {value_type: string}' to 'column_options: {...}' option to convert the values to strings, or exclude the column from 'select:' option
|
|
12
|
+
```
|
|
13
|
+
|
|
14
|
+
_input.yml.liquid
|
|
15
|
+
|
|
16
|
+
```
|
|
17
|
+
in:
|
|
18
|
+
type: mysql
|
|
19
|
+
host: {{ env.IN_MYSQL_HOST }}
|
|
20
|
+
user: {{ env.IN_MYSQL_USER }}
|
|
21
|
+
password: {{ env.IN_MYSQL_PASSWORD }}
|
|
22
|
+
database: dbA
|
|
23
|
+
select: "*"
|
|
24
|
+
options: {useLegacyDatetimeCode: false, serverTimezone: Asia/Tokyo}
|
|
25
|
+
|
|
26
|
+
```
|
|
27
|
+
|
|
28
|
+
_output.yml.liquid
|
|
29
|
+
|
|
30
|
+
```
|
|
31
|
+
out:
|
|
32
|
+
type: mysql
|
|
33
|
+
mode: replace
|
|
34
|
+
host: {{ env.OUT_MYSQL_HOST }}
|
|
35
|
+
user: {{ env.OUT_MYSQL_USER }}
|
|
36
|
+
password: {{ env.OUT_MYSQL_PASSWORD }}
|
|
37
|
+
database: dbA
|
|
38
|
+
select: "*"
|
|
39
|
+
```
|
|
40
|
+
|
|
41
|
+
config.yml.liquid
|
|
42
|
+
```
|
|
43
|
+
{% include 'input' %}
|
|
44
|
+
table: tableA
|
|
45
|
+
{% include 'output' %}
|
|
46
|
+
table: tableA
|
|
47
|
+
column_options:
|
|
48
|
+
columnA: {value_type: string}
|
|
12
49
|
```
|