Using readers and writers to extract and load data.
Recently active
I am trying to create schema and upload data to PostGIS facing Error "2018-11-29 09:18:58| 13.8| 0.1|ERROR |Bulk copy failed on table 'FIN.match_tt' using delimiter ':'. Error was 'ERROR: extra data after last expected columnCONTEXT: COPY match_tt, line 1: "00004649-3100-0400-0000-0000000ab870:30:5.39508913314117:85.76780709963086:80.37271796648969:5.05078..."'2018-11-29 09:18:58| 13.8| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details2018-11-29 09:18:58| 13.8| 0.0|ERROR |Bulk copy failed on table 'FIN.match_tt' using delimiter ':'. Error was 'no COPY in progress'2018-11-29 09:18:58| 13.8| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details" can any one help Please find log file for reference.
Hi,I have an ExcelStyler set with a specific cell background colour. However I want to override this setting for a specific column in my output spreadsheet so I have set a different background colour in the 'Formatting' section of the ExcelWriter. But column in the output spreadsheet is the colour I set in the ExcelStyler rather than the ExcelWriter.I am using FME 2018.1Thanks
Some of my workspaces contain multiple checks before any data is processed and are hooked up to some Terminator transformers. Is there a way to show the custom error message, that is included in the Terminator, in the web gui instead of the default translation failed message? Although the terminator message is in the log file, I would prefer the message be shown to the end user instead of having to access the log file. FME Server 2018.1
I'm looking at 2019 beta. Is there a way that an S3 block can be seamless when writing to a ESRI file geodatabase, or are multiple steps involved that require creating the FGDB and then zipping it up for transfer. I'm not seeing a way using the S3 connector. Obviously I would rather the most seamless and simplest method...more like a virtual file/folder location parameter using the saved web connection and credentials.
Greetings for the day, Can anyone please help me to know that IFC entities are case sensitive or not. For example, if I use “ifcproduct” or “IfcProduct” instead of “IFCPRODUCT” in .ifc file it is right or not. Thank you.
I need to re or write GIS data to an EPANET (hydaulic) file forma. On that moment I use a dedicated externat script but would appreciate to do it in an FME environment
Hi there, I have a hosted feature service which has to get updated with the records from a web app. On the basis of that, I would like to create a workbench where I can use the fields from hosted feature service and using a custom word template I can generate a report. Any help regarding this is much appreciated. Thanks,Anu
I know relatively little about Revit so this may be a noob question. I've got a Revit drawing with features that have an image draped across it, basically signs and what they look like. I can translate the Revit data to geodatabase without issue, but those images don't come across to the multipatch features in ArcGIS. There is no way in Esri to do this programatically (they have a SketchUp workaround) and I was wondering if there was a way to maintain those during the translation?
I have a collection of .zip files (ie. AB_170203, BC_180203) that I would like to move from one drive to another for archiving purposes. I have a tester set up to separate the .zip based on date and now I just need the .zip's to move. Writer ParametersFile Operation:MOVE Copy Source Folder: NoCopy Subfolders: Yes The process will complete but nothing moves.
Dear FME'ersI have a SpatiaLite file, which I can read with the SpatialLite reader in Workbench. However, there is one non-geometrical table, which does not pop up in the Feature Classes.So, I thought, I read this table with the 'SQLite Non-Spatial' Format. I get following error:SQLite 3 Reader: Opening `Z:\\Connector\\GPS2Sirius\\TC_NM_DataFileGPS_V6.sqlite' for read operationSQLITE3 reader: Database query 'PRAGMA table_info("ElementaryGeometries");' failed. SQLite3 Engine error: 'no such module: VirtualElementary'However, in the Data Inspecter, I can open the data with the same reader. Does anyone have an explanation for this? The SpatiaLite database is filled in QGis, but I do not know how it was created initially.
Hello ! I am joining some data with information included in distinct CSV files. For this joining, I use the DatabaseJoiner. As it is quite big CSV files (> 7M entries), the index creation takes some times before actually making the join. However, as the input data are big also, I am processing the joins by tiles, but it means that for each tiles, the DatabaseJoiner is creating its own index again before joining and so on... Is it a parameter or something else to write somewhere this created index so that it only have to read it again to use on the other tiles ? Many thanks ! Nicolas
I have a dataset with a large number of areas (tiles) that border each other. Each area contains a large number of shape files. Each area folder holds the same types of data. All files have unique names.They have the following syntax: area_datatype.shp.I would like to merge all the files of a similar datatype into one. So instead of having X areas with Y shape files in each I would like to have Y shapefiles covering all areas X.The standard procedure is to build a dynamic work space and use fme_feature_type for the output, but I can't get it working this time. My guess is that I somehow need to pull the name of the data table, if that is possible? Or is there some nifty setting that I might have missed?Any advice on how I can get this to work?
Hello! I need to copy the contents of a sheet in a Gsheet format into an xls sheet of an existing file that have others sheets. the operation must overwrite the sheet only by emptying it and repopulating it, but I lose the column names even if I have selected the output field names option. what am I doing wrong?
Hello everybody,I have huge problem - working with SVG format, Im new one in work with this format. I have many questions please, how to figure it out in FME:1.) How could I create body of SVG like this:It means create tags <title>; <defs>; <pattern> etc.2.) How could I put 'elem_type' attribute into <g> quotes (like above)?3.) How could I put text content between <text> quotes without prefix CDATA, check below?My aim is to get line like this: <text stroke=rgb(0,0,0).................................>22.11.1999</text>Please, help me! :-)Thanks, Lubo
In FME Workbench, we can see the "help" of Transformers or Formats when clicking on it. But, it does not work for my part for the custom formats although there is a description inside the custom format : Format Parameters > Description > Help . Is there a specific procedure to follow or maybe it is not possible ?Thank you.
I would like to search by zip and for the Zip Code area would be returned on the map. Please advise, Thanks!
Hello! Ihave a task to convert data from dgn (v8) into any of the vector formats that can be opened by QGis and then converted back. The following conditions must be met:1. Saving tag information, including field names, which can be quite long (in this connection, the shape format is not suitable, when converted in which the column names are cut off).2. Preservation of connections in between the elements of complex objects (cells) with aggregation during the subsequent reverse conversion.If the first condition is satisfied, for example, when using the tab format as output, then there is difficulty with the second one. Our data is looks like this:and this:We have an existing workflow, which is not working properly and can be attached here. But I'm not sure that our way is optimal and want to ask your advice which way of transformation could be best for saving such information?
Hello, I have workspaces runner in my work flow triggering another workbench doing analysis and writhing data in to the geodatabase (Esri Geodatabase (File Geodb Open API) also tried with POSTGIS but still same issue. I am facing slowness processing 2000 records running process more that 2hours then terminated can any one help me to overcome this issue it’s taking so much time.
In MS Access database, the Occurrence table has an XML data type field called “ReportDataXML”. This field contains details/values for all the fields on a particular form for a given record.I need this field transposed to a table for each record in the Occurrence table. The transposed table should have columns for record id and the xml values for each node – see second table for an example of what I’m after. Source data sample – record id = 6, ReportDataXML field extract only for 3 fields.Occurrence table ID field has value:6ReportDataXml field has the following content (exerpt only):<F7183047af02945f1aa4cf819519c1b72 xmlns="http://www.gaelquality.com/Bacchus/OccurrenceFields" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <DataType>list-reference</DataType> <Value>3193</Value> <Archived>false</Archived> </F7183047af02945f1aa4cf819519c1b72> <Fa080141ebf5b417999a0b5da90569306 xmlns="http://www.gaelquality
Hi,I was wondering if there is any way to write from an Oracle Spatial Object to Excel, the following attributes:- Column Names- Data Types- Nullable- Triggers- Dependencies- Constraints- Indexes- SQLand so on?Perhaps this is more of a question of knowing in Oracle where these tables are stored? I am using FME desktop 2018.1Thanks,
Running an automated script that gets data from another source to map. Have table in SDE (10.3.1) and set to Insert with Truncate Existing. The table is not truncating. It appears to work with Drop and Create. However, we want to keep the permissions and such intact, therefore using Truncate. This feed started today with about 15 rows, changed to 8 rows, then to 0 rows, back to 8 rows. This data is being used in a Dashboard on ESRI Portal for real time reporting. FME 2018.1.0.2 64 bit Build 18547 ArcDestop 10.3.1Thanks,
I generated some 3D tiles data using Cesium 3D tiles writer.Then shader effect is appeared in all of 3D tiles data.The Cesium 3D Tiles writer seems to write the shader effect in b3dm data by default.I would like to remove the effect from those 3D tiles data.Could you tell the solution?
Created a workbench to download and save on local disk, from S3 to local disk and read csv using featureReader works fine with FME Desktop (20181203 - Build 18578 - WIN64). Publishes same workbench to FME Server with additional parameters like file name etc and run through post call, failed to process csv file with following message: CSV reader: The keyword _DELIMITER has an invalid value: 'auto'. It must be a single character that is representable by one byte in utf-8BADNEWS: A fatal error has occurred. Check the logfile above for details (dynaread.cpp:199)A fatal error has occurred. Check the logfile above for details(dynaread.cpp:199). How do I track this fatal error ?
Trying to capture network traffic when FME Server writes to and reads from REST Services on ArcGIS Online to debug an issue with readers/writers and arcgis online. I followed all of these steps to setup and configure the proxy, but didn't seem to be working completely.Additionally, do we need to run fiddler on the account that FME server is ran on or can we do it through an admin account on the machine? We tried both Fiddler 2 and 4. In version 2, the FME account could see some of the traffic that was coming from jobs that were being ran in addition to traffic from the admin account. My admin account couldn't see any of the traffic from the FME user, but did see mine.
I am trying to read attachments from an AGOL feature service. Specifically, it is a jpg image. I have the reader feed into a BinaryDecoder set to Base64, outputting Binary(fme-binary), then going into a rasterreplacer. Error occurs on the BinaryDecoder. The error is:BinaryDecoder(TextEncoderFactory): Invalid Base64 character 'ÿ'Does anyone know how to handle or avoid this error? Thanks!