Oracle Database is a relational database management system (RDBMS) from Oracle Corporation. This article provides a complete overview of the Oracle database, including features, history, and editions. Before discussing Oracle, let’s first understand the basics of a database.
The config
section in a YAML file includes the following properties:
Connectorname: Oracle
host: Hostname or IP address of the server
port: Server running port
username: Username
password: Password
database: Database
service_name: servicename
drivername: oracle+pyoracle
Data Hub
icon on the Navigation Pane.Add Project
and provide the new project’s name.Oracle
template.Parameters | Description |
---|---|
Host: | Specify the hostname of the Oracle server. |
Port: | Specify the port number of the Oracle server (default is 1521). |
Username: | Provide the username to authenticate with the Oracle server. |
Password: | Provide the password to authenticate with the Oracle server. |
Database: (Optional) | Specify the name of the Oracle database from which data will be extracted. |
Service Name: (Optional) | Specify the Service name of the Oracle server. |
Driver Name: | Specify the driver name for connecting to Oracle (e.g., oracle+oracledb). |
Select: | Tablename(s): Specify the name list to load tables from the Oracle server. |
Metadata: (Optional) | Replication Method: Specify the replication method for the table(s). Options include FULL or INCREMENTAL. |
Replication Key: Specify the replication key for incremental replication. This key helps in identifying new or updated records. | |
Replication Value: Specify the replication value to start the incremental replication from a particular point. |
Run Now
button..
Edit DataSource
Option to view the created tables.In the metadata section, define the mode of data refresh. There are two modes: INCREMENTAL and FULL_TABLE. It only supports DateTime datatype columns.
This mode fetches data from the date column mentioned in the replication key from the start date as mentioned in the replication value. Once scheduled, the replication value is updated automatically from the imported data.
metadata:
TableName:
replication_method: INCREMENTAL
replication_key: Column name
replication_value: column value that data starts from
This mode fetches data from the date column specified in the replication key starting from the date specified in the replication value. Once scheduled, the replication value is updated according to the interval_type and interval_value from the imported data. For example, if the interval_type is set to ‘year’ and the interval_value is set to ‘1’, the first schedule will fetch records from January 1, 2000 to December 31, 2000. In the next schedule, it will fetch records from January 1, 2001 to December 31, 2001, and so on.
metadata:
TableName:
replication_method: FULL_TABLE
replication_key: Column name
replication_value: column value that data starts from
interval_type: days/hours/minutes/year/month
interval_value: integer value to add in interval type
version: 1
encrypt_credentials: false
plugins:
extractors:
- name: tap_postgres
connectorname: Oracle
config:
host: Hostname or IP address of the server
port: Server running port
username: Username
password: Password
database: Database
service_name: servicename
drivername: oracle+pyoracle
select:
- TABLE1
- TABLE2
metadata:
TABLE1:
replication_method: FULL_TABLE
replication_key: last_modified_on
replication_value: 2023-07-19 00:00:00
interval_type: days
interval_value: 6
TABLE2:
replication_method: FULL_TABLE
replication_key: last_modified_on
replication_value: 2023-07-19 00:00:00
interval_type: days
interval_value: 6
version: 1
encrypt_credentials: true
plugins:
extractors:
- name: tap_postgres
connectorname: Oracle
config:
host: Hostname or IP address of the server
port: Server running port
username: Username
password: Password
database: Database
service_name: servicename
drivername: oracle+pyoracle
select:
- TABLE1
- TABLE2
metadata:
TABLE1:
replication_method: INCREMENTAL
replication_key: last_modified_on
replication_value: 2023-07-19 00:00:00
TABLE2:
replication_method: INCREMENTAL
replication_key: last_modified_on
replication_value: 2023-07-19 00:00:00