Hi all,
I'm using the AmazonAthenaConnector to query an Athena database.
In the Translation Log I'm seeing:
"2023-03-10 09:04:27| 6.1| 0.0|INFORM|AmazonAthenaConnector: Query ran successfully. Run time: 5.225 seconds. Data scanned: 27694.09 kB"
I'd like to use the info on the file size / Data scanned to do some cost calculation.
1: Is there a way to incorporate the output of the Translation Log as attributes in the workbench?
Alternatively I guess I could load the .log file in a workbench and use that for the calculations...
2: I am wondering , can I run the main translation AND the .log file in the same workbench? (wait for the main translation to have finished so it can read in the log file and perform operations on that.)