Emory Catalog Management

Emory Catalog Management #

Download catalog, query backups and delete expired backups using your command line interface.

Download catalog #

You can download the last known catalog, that is the one that is stored on Backup Storage.

$ /opt/emory/emory --catalog download

Query backups #

Summary of backups #

Print a CSV format output of the summary of backups that emory catalog has ever taken (deleted backups will not be retrieved)

$ /opt/emory/emory --catalog list
EBID;ID;ExpirationDate;UID;Level;LcType;SourceDB;Size;Status
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;26477331386;completed
bfezfscp;2;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;10528370324;completed
bfezftxm;3;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;26477330761;completed
bfezfufe;4;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;10528380014;completed
bfezfzyj;9;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;0;failed
bfezgdad;10;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;0;failed
bfezgdha;11;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;0;failed
bfezgdoq;12;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;0;failed
bfezgdvl;13;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;0;failed
bfezgeir;14;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;0;failed
affccrnu;49;2020-11-24 19:32:01.393679216 +0100 +0100;LNK;ARCHIVE;D;LNK;106713103;completed
bffccrvy;50;2020-11-24 19:35:30.152645754 +0100 +0100;LNK;FULL;D;LNK;25638384453;completed
bffccskd;51;2020-11-24 19:41:38.893167144 +0100 +0100;LNK;FULL;D;LNK;25638385104;completed
bffccxqw;52;2020-11-24 20:40:51.583982694 +0100 +0100;LNK;FULL;D;LNK;25638384482;completed
bffcfezm;53;2020-11-25 07:49:22.349845953 +0100 +0100;LNK;FULL;D;LNK;25638385114;completed
bffcffog;54;2020-11-25 07:55:45.596442965 +0100 +0100;LNK;FULL;D;LNK;6359163087;completed
affcfjyl;59;2020-11-25 08:45:12.159030419 +0100 +0100;LNK;ARCHIVE;D;LNK;97468868;completed
bffcfkti;60;2020-11-25 08:54:17.754935487 +0100 +0100;LNK;FULL;D;LNK;25638385370;completed
bffcflxg;61;2020-11-25 09:07:14.094446896 +0100 +0100;LNK;FULL;D;LNK;25638385830;completed
...

Complete information of backups #

This command prints a CSV format output with all details of backups that emory catalog has ever taken (deleted backups will not be retrieved)

$ /opt/emory/emory --catalog --detail list
EBID;ID;ExpirationDate;UID;Level;LcType;SourceDB;File;S3Object;Size;S3Bucket;Encryption;Status
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapbackup/backLNK.log;LNK/LNK/2020/10/25/bfezfrvg/backLNK.log;4664;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapbackup/bfezfrvg.aff;LNK/LNK/2020/10/25/bfezfrvg/bfezfrvg.aff;109450;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapprof/initLNK.utl;LNK/LNK/2020/10/25/bfezfrvg/initLNK.utl;485;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapreorg/spaceLNK.log;LNK/LNK/2020/10/25/bfezfrvg/spaceLNK.log;91;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapprof/initLNK.ora;LNK/LNK/2020/10/25/bfezfrvg/initLNK.ora;3205;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapprof/spfileLNK.ora;LNK/LNK/2020/10/25/bfezfrvg/spfileLNK.ora;5632;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapprof/initLNK.sap;LNK/LNK/2020/10/25/bfezfrvg/initLNK.sap;31027;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/origlogA/cntrl/cntrlLNK.dbf;LNK/LNK/2020/10/25/bfezfrvg/cntrlLNK.dbf;21479424;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/origlogB/log_g14m1.dbf;LNK/LNK/2020/10/25/bfezfrvg/log_g14m1.dbf;209715712;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/origlogB/log_g12m1.dbf;LNK/LNK/2020/10/25/bfezfrvg/log_g12m1.dbf;209715712;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/origlogA/log_g13m1.dbf;LNK/LNK/2020/10/25/bfezfrvg/log_g13m1.dbf;209715712;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/origlogA/log_g11m1.dbf;LNK/LNK/2020/10/25/bfezfrvg/log_g11m1.dbf;209715712;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata1/system_1/system.data1;LNK/LNK/2020/10/25/bfezfrvg/system.data1;723525632;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata1/sysaux_1/sysaux.data1;LNK/LNK/2020/10/25/bfezfrvg/sysaux.data1;1006641152;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata1/undo_1/undo.data1;LNK/LNK/2020/10/25/bfezfrvg/undo.data1;796925952;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata3/sr3752_5/sr3752.data5;LNK/LNK/2020/10/25/bfezfrvg/sr3752.data5;2097160192;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata4/sr3usr_1/sr3usr.data1;LNK/LNK/2020/10/25/bfezfrvg/sr3usr.data1;20979712;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata3/sr3752_4/sr3752.data4;LNK/LNK/2020/10/25/bfezfrvg/sr3752.data4;2097160192;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata3/sr3752_3/sr3752.data3;LNK/LNK/2020/10/25/bfezfrvg/sr3752.data3;2097160192;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata3/sr3752_1/sr3752.data1;LNK/LNK/2020/10/25/bfezfrvg/sr3752.data1;2097160192;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata3/sr3752_2/sr3752.data2;LNK/LNK/2020/10/25/bfezfrvg/sr3752.data2;2097160192;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata2/sr3_4/sr3.data4;LNK/LNK/2020/10/25/bfezfrvg/sr3.data4;2097160192;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata2/sr3_5/sr3.data5;LNK/LNK/2020/10/25/bfezfrvg/sr3.data5;2097160192;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata2/sr3_6/sr3.data6;LNK/LNK/2020/10/25/bfezfrvg/sr3.data6;2097160192;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata2/sr3_3/sr3.data3;LNK/LNK/2020/10/25/bfezfrvg/sr3.data3;2097160192;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata2/sr3_2/sr3.data2;LNK/LNK/2020/10/25/bfezfrvg/sr3.data2;2097160192;emory-backup-charlatans;AES256;completed
bfezfrvg;1;0001-01-01 00:00:00 +0000 UTC;LNK;FULL;;LNK;/oracle/LNK/sapdata2/sr3_1/sr3.data1;LNK/LNK/2020/10/25/bfezfrvg/sr3.data1;2097160192;emory-backup-charlatans;AES256;completed
bfezfscp;2;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;/oracle/LNK/sapbackup/backLNK.log;LNK/LNK/2020/10/25/bfezfscp/backLNK.log;4885;emory-backup-charlatans;AES256;completed
bfezfscp;2;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;/oracle/LNK/sapreorg/spaceLNK.log;LNK/LNK/2020/10/25/bfezfscp/spaceLNK.log;91;emory-backup-charlatans;AES256;completed
bfezfscp;2;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;/oracle/LNK/sapbackup/bfezfscp.pnf;LNK/LNK/2020/10/25/bfezfscp/bfezfscp.pnf;64903;emory-backup-charlatans;AES256;completed
bfezfscp;2;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;/oracle/LNK/sapprof/initLNK.utl;LNK/LNK/2020/10/25/bfezfscp/initLNK.utl;485;emory-backup-charlatans;AES256;completed
bfezfscp;2;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;/oracle/LNK/sapprof/initLNK.sap;LNK/LNK/2020/10/25/bfezfscp/initLNK.sap;31027;emory-backup-charlatans;AES256;completed
bfezfscp;2;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;/oracle/LNK/sapprof/spfileLNK.ora;LNK/LNK/2020/10/25/bfezfscp/spfileLNK.ora;5632;emory-backup-charlatans;AES256;completed
bfezfscp;2;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;/oracle/LNK/sapprof/initLNK.ora;LNK/LNK/2020/10/25/bfezfscp/initLNK.ora;3205;emory-backup-charlatans;AES256;completed
bfezfscp;2;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;/oracle/LNK/sapbackup/cntrlLNK.dbf;LNK/LNK/2020/10/25/bfezfscp/cntrlLNK.dbf;21479424;emory-backup-charlatans;AES256;completed
bfezfscp;2;0001-01-01 00:00:00 +0000 UTC;LNK;PARTIAL;;LNK;/oracle/LNK/sapdata3/sr3752_5/sr3752.data5;LNK/LNK/2020/10/25/bfezfscp/sr3752.data5;2097160192;emory-backup-charlatans;AES256;completed

Detailed information of backup #

You can retrieve details from an specific backupid

$ /opt/emory/emory --catalog --backupid bffcflxg info
EBID                : bffcflxg
ID                  : 61
ExpirationDate      : 2020-11-25 09:07:14.094446896 +0100 +0100
UID                 : LNK
Level               : FULL
LcType              : D
SourceDB            : LNK
Bucket              : linke-emory-demos
Encryption          : aws:kms
Status              : completed
Backup Files        :
      File 0
          Name   : /oracle/LNK/sapbackup/bffcflxg.fnf
          Key    : LNK/LNK/2020/11/10/bffcflxg/bffcflxg.fnf
          Size   : 15668
          Status : completed
      File 1
          Name   : /oracle/LNK/sapreorg/spaceLNK.log
          Key    : LNK/LNK/2020/11/10/bffcflxg/spaceLNK.log
          Size   : 91
          Status : completed
      File 2
          Name   : /oracle/LNK/sapbackup/backLNK.log
          Key    : LNK/LNK/2020/11/10/bffcflxg/backLNK.log
          Size   : 15714
          Status : completed
...
...
      File 21
          Name   : /oracle/LNK/sapdata2/sr3_4/sr3.data4
          Key    : LNK/LNK/2020/11/10/bffcflxg/sr3.data4
          Size   : 2097160192
          Status : completed
      File 22
          Name   : /oracle/LNK/sapdata2/sr3_2/sr3.data2
          Key    : LNK/LNK/2020/11/10/bffcflxg/sr3.data2
          Size   : 2097160192
          Status : completed

Delete expired backups # 

$ /opt/emory/emory --catalog --dryrun delete

With dryrun flag you will see only the files that will be deleted

Modify lifecycle details #

There is a way to modify specific backup lifecycle settings. You will be able to modify expiration date of backup or lifecycle type or both of them.

$ /opt/emory/emory --catalog -h expiration
Usage: /opt/emory/emory OPTIONS <command>

OPTIONS

--backupid <backup_id>  Backup ID to retrieve information from
--date <2040-12-31>     Set new date for expiration (YYYY-MM-DD)
-h, --help              print help and exit
--lctype <D>            Set new lifecycle type to specific backup (D, W, M or Y)

COMMANDS

expiration              Change expiration date to specific backup

Example 1: Modify expiration date # 

$ /opt/emory/emory --catalog --backupid bfgvqtjq --date 2022-01-03 expiration

Example 2: Modify lifecycle type # 

$ /opt/emory/emory --catalog --backupid bfgvqtjq --lctype W expiration

Example 3: Modify lifecycle type and expiration date # 

$ /opt/emory/emory --catalog --backupid bfgvqtjq --date 2022-01-03 --lctype W  expiration