Import Export Cassandra keyspaces


I have study purpose Cassandra on Windows 7 (3 keyspaces) and want to copy it on new Cassandra cluster (Linux)

1) Import keyspaces, just structures.


cqlsh -e "DESCRIBE MTS_BARS" > C:\cassdump\mts_bars.cql
cqlsh -e "DESCRIBE MTS_META" > C:\cassdump\mts_meta.cql
cqlsh -e "DESCRIBE MTS_SRC" > C:\cassdump\mts_src.cql


There are some files that can be opened with notepad and contains SQL like queries to CREATE KEYSPACE, CREATE TABLE.

2) Export data with COPY TO (simple-data-importing-and-exporting)
Connect to cqlsh and execute commands:


COPY MTS_SRC.TICKS TO 'C:\cassdump\mts_src_ticks.cql' WITH HEADER=FALSE;
COPY MTS_BARS.BARS TO 'C:\cassdump\mts_bars_bars.cql' WITH HEADER=FALSE;

COPY MTS_BARS.bars_future TO 'C:\cassdump\mts_bars_bars_future.cql' WITH HEADER=FALSE;
COPY MTS_BARS.bars_test TO 'C:\cassdump\mts_bars_test.cql' WITH HEADER=FALSE;
COPY MTS_BARS.LASTBARS TO 'C:\cassdump\mts_bars_lastbars.cql' WITH HEADER=FALSE;
COPY MTS_BARS.pattern_search_results TO 'C:\cassdump\mts_bars_pattern_search_results.cql' WITH HEADER=FALSE;
COPY MTS_BARS.trade_advisers_results_bars TO 'C:\cassdump\mts_bars_trade_advisers_results_bars.cql' WITH HEADER=FALSE;

COPY MTS_META.bar_price_distrib TO 'C:\cassdump\mts_meta_bar_price_distrib.cql' WITH HEADER=FALSE;
COPY MTS_META.bars_property TO 'C:\cassdump\mts_meta_bars_property.cql' WITH HEADER=FALSE;
COPY MTS_META.bars_property_last_deeps TO 'C:\cassdump\mts_meta_bars_property_last_deeps.cql' WITH HEADER=FALSE;
COPY MTS_META.tickers TO 'C:\cassdump\mts_meta_tickers.cql' WITH HEADER=FALSE;
COPY MTS_META.trade_advisers_results TO 'C:\cassdump\mts_meta_trade_advisers_results.cql' WITH HEADER=FALSE;
COPY MTS_META.trade_advisers_ticker TO 'C:\cassdump\mts_meta_trade_advisers_ticker.cql' WITH HEADER=FALSE;
COPY MTS_META.way_adviser_n_hours TO 'C:\cassdump\mts_meta_way_adviser_n_hours.cql' WITH HEADER=FALSE;


3) Copy files or archive with WinScp on Cassandra cluster machine. And make Import.

Import keyspaces:


[root@sc1 ~]# cqlsh 192.168.122.192 -e "SOURCE '/root/mts_src.cql'"
[root@sc1 ~]# cqlsh 192.168.122.192 -e "SOURCE '/root/mts_meta.cql'"
[root@sc1 ~]# cqlsh 192.168.122.192 -e "SOURCE '/root/mts_bars.cql'"

//Change replication factor, on local PC it was equal 1.

ALTER KEYSPACE mts_src
WITH replication = {
 'class' : 'SimpleStrategy',
 'replication_factor' : 3
};

ALTER KEYSPACE mts_meta
WITH replication = {
 'class' : 'SimpleStrategy',
 'replication_factor' : 3
};

ALTER KEYSPACE mts_bars
WITH replication = {
 'class' : 'SimpleStrategy',
 'replication_factor' : 3
};



Import table(columns family) data with COPY FROM:


[root@sc1 ~]# cqlsh 192.168.122.192
Connected to cass cluster at 192.168.122.192:9042.
[cqlsh 5.0.1 | Cassandra 3.11.3 | CQL spec 3.4.4 | Native protocol v4]
Use HELP for help.

cqlsh> COPY MTS_SRC.TICKS FROM  '/root/mts_src_ticks.cql' WITH HEADER=FALSE;

COPY MTS_BARS.BARS FROM  '/root/mts_bars_bars.cql' WITH HEADER=FALSE;

COPY MTS_BARS.bars_future FROM  '/root/mts_bars_bars_future.cql' WITH HEADER=FALSE;
COPY MTS_BARS.bars_test FROM  '/root/mts_bars_test.cql' WITH HEADER=FALSE;
COPY MTS_BARS.LASTBARS FROM  '/root/mts_bars_lastbars.cql' WITH HEADER=FALSE;
COPY MTS_BARS.pattern_search_results FROM  '/root/mts_bars_pattern_search_results.cql' WITH HEADER=FALSE;
COPY MTS_BARS.trade_advisers_results_bars FROM  '/root/mts_bars_trade_advisers_results_bars.cql' WITH HEADER=FALSE;

COPY MTS_META.bar_price_distrib FROM  '/root/mts_meta_bar_price_distrib.cql' WITH HEADER=FALSE;
COPY MTS_META.bars_property FROM  '/root/mts_meta_bars_property.cql' WITH HEADER=FALSE;
COPY MTS_META.bars_property_last_deeps FROM  '/root/mts_meta_bars_property_last_deeps.cql' WITH HEADER=FALSE;
COPY MTS_META.tickers FROM  '/root/mts_meta_tickers.cql' WITH HEADER=FALSE;
COPY MTS_META.trade_advisers_results FROM  '/root/mts_meta_trade_advisers_results.cql' WITH HEADER=FALSE;
COPY MTS_META.trade_advisers_ticker FROM  '/root/mts_meta_trade_advisers_ticker.cql' WITH HEADER=FALSE;
COPY MTS_META.way_adviser_n_hours FROM  '/root/mts_meta_way_adviser_n_hours.cql' WITH HEADER=FALSE;


Комментарии

  1. I appreciate this piece of useful information. We are Provides Online Course for Export
    Import Business, With our online training Certification Program you will learn how to Start Export Import Business For more information visit our site: online course import export

    ОтветитьУдалить

Отправить комментарий

Популярные сообщения из этого блога

Loading data into Spark from Oracle RDBMS, CSV

Load data from Cassandra to HDFS parquet files and select with Hive

Hadoop 3.0 cluster - installation, configuration, tests on Cent OS 7