Using readers and writers to extract and load data.
Recently active
I’m trying to output all property sets from IFC files into separate Excel sheets. So far I’ve found all of the property sets, their attributes and their attribute values. This is my data:What I would like to do is transpose this list into separate lists for each property set like so: After that I could simply write each list to separate Excel sheets, but this is where I get stuck. I create the sheets by feeding the writer from a DuplicateFilter, but how do I join each PsetAttribute to Pset as well as transpose the data so each PsetAttribute is a single column?I need to do it without knowing the exact names or number of property sets existing in each IFC file as well.
Hi,After a migration to Office365, FME is unable to open Access files. The following error is given:Microsoft Access Reader: Unable to find provider 'Microsoft.ACE.OLEDB.12.0', falling back to 'Microsoft.Jet.OLEDB.4.0'. The 2007 Office System Driver might be missing from your system; follow this link for more information: http://www.microsoft.com/download/en/details.aspx?displaylang=en&id;=23734Microsoft Access Reader: Connection failed. Connection string `Provider=Microsoft.Jet.OLEDB.4.0;Jet OLEDB:Engine Type=5;Data Source=K:\\dienst VR\\02_rapporten\\Lijst_SEVESO-inrichtingen 2016.accdb;User ID=admin;Password='. Provider error `(-2147467259) Onbekende database-indeling K:\\dienst VR\\02_rapporten\\Lijst_SEVESO-inrichtingen 2016.accdb.'We tried installing 2007 Office System Driver, as given via the link in the error message, but this did not solve te issue. The following error message still appears:Microsoft Access Reader: Connection failed. Connection stri
Host Revit file has 137 linked files. When I try to read even a small portion of these I get the error.Failed to obtain any schemas from reader 'REVITNATIVE' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information.I’m using a FeatureReader linked to the Metadata.LinkedInformation output of the host Revit file (first strcating the LinkedFilePath and Name attributes). I get this error even when I limit the input to one record. Separately, a FeatureReader (along with Creator to initiate) can read one of these files. I saw a similar post where the answer was to change the FME_Temp folder. I don’t think this will make a difference since I get the error when only trying one file. I would try this but I need admin rights to set this up on my computer and I won’t be able to get that until next week. Also, I would rather know for sure before I ask. Thanks in advance.
Is there a way to join two tables using the between operator (SQL). I know I can use SQLCreator but I would like to do this join directly in workbench. sql example: TABLE1.*,TABLE2.*FROM TABLE1LEFT JOIN TABLE2 ON TABLE1.NAME = TABLE2.NAME AND TABLE1.DATE BETWEEN TABLE2.FROM AND TABLE2.TO
I have a database NAME1.If I open them as Oracle Non-Spatial I can access the following tablesNAME1.AANAME1.BBNAME1.CCNAME1.DDNAME1.EEIf I open them as Oracle Spatial I can access the following tablesNAME1.CCNAME1.DD The database contains more than 50 tables. They must be transferred to POSTGIS database with a different schema name: name2I have already looked up some things in the community. But those are old posts and some transformers don't even exist. What is the best way to approach this? in short:Oracle NonSpatial tables and Spatial tables from 1 database to POSTGIS database with a different schema name. Who can help me and or has an example? Thanks in advance
Before the web presentation of Safe and FME changed to what they are now It was possible to find the zipped FMEData. Data that are pointed at in almost every exercise in the FME Academy, community postings and videos.The new FME page does not provide the “knowledge” structure anymore as before and all links in the community etc. are pointing straight into Nirvana.I can see that these resource now can be found at https://s3.amazonaws.com/FMEData, however, I cannot get a listing of the content of this bucket and I always end up with a 403. Without a listing it is impossible to guess the specific file I am interested in…Can somebody point me to an URL where I can get the latest version of the FMEData?
The IFC data was exported using ArcGIS Pro. After importing it into FME Data Inspector, the following errors occurred:ISO10303-21: Skipping instance #50: Instance is not syntactically valid An error has occurred. Check the logfile above for details Failed to specify the feature index as constraints on the reader Could anyone please help with this? Thank you!
When trying to read an IFC file, I am getting an error ISO10303-21: Skipping instance #1154: Instance is not syntactically valid. How can this be fixed?
I need to copy records from one hosted feature layer in ArcGIS Online to another hosted feature layer. Schemas are identical. Some of the records in the source data have an attachment (only 1 per feature/record so only in the 0 position in the list). No problem getting all of the records to write from the source to the destination but the attachments are not included. Anyone know how to do bring over the attachments with the rest of the data?
Though experienced with reading WFS's, I'm a little bit frustrated about reading a WFS2.0 in the FeatureReader. It seems it is not paginating. Checking the WFS GetCapabilities, 'FeaturePaging’ is not mentioned.I want to query the WFS with a polygon. So that is my initiator. But I'm not sure whether the results exceeding the 50k or 100k or even 200k. That's why I want some sort of ‘FeaturePaging’. Anyone an idea on how to solve my issue? It's probably simple, but I can't see it at the moment.
Hi, I need help. I have an attribute column X with string values ‘S001’, ‘S002’, ‘S003’, and ‘S004’, all lined up in 1 column with 4 rows corresponding to the string values. I would like the output Y should to be a single row list, having just one column and one row, containing the four values:Y = (‘S001’, ‘S002’, ‘S003’, ‘S004’) Could you please advise how this could be done in FME Form. Greatly appreciated. Thanks, Willy de Vera
Hi, got a question from a client yesterday who wants (with FME2018.1) to connect to a SQL Server 2000 database (no the question is not from a museum: ).FME returns a Fetching Feature Types Error, "... SQL Server Native Client 11.0 does not support connections to SQL Server 2000 or earlier versions".Any ideas the minimum hazzle to get around here? Just to install the SQL Server native client 9.00 and problem solved? I do not have an environment for testing this myself :/ cheers
Hi,I am trying to request information from FMEflow with an httpcaller. I have created a temporary token that allows everything. If I include the token in the URL, the request works fine. (https://<...?/v3/info?fmetoken=abcdefg...)When I put the token in the httpcaller I get a 401 warning. What goes wrong in the caller?
Hi, I am trying to convert raster data in the forms of .grd, tiff or GRID from ArcGIS Pro into a csv/table. If anyone can point me in the right direction, that would be greatly appreciated. GRD file loaded on ArcGIS Pro
version: 2024I am trying to convert data from fgdb to dgn. I used AttributeSplitter and DGNStyler to reassign size and width to each text elements. Single line text is work but seem mutiplate line text attribute igds_text_width_multiplier cannot write to dgn. Is igds_text_width_multiplier in DGNStyler cannot update igds_multi_text?Remark: I tried FME 2021 is work. mutiplate line text attribute igds_text_width_multiplier can write to dgn.
Firstly I combined my building objs by Aggregator, then I separated them by Deaggregator, finally to b3dm. I have coordinates of those building objs but All building overlapped in Cesium, How can i locate the buildings according to coordinates.
Hi, I have created a gdb with 2 feature classes, strings and points. But it only works the first time. Every time I make changes to the model and run it again I get errors. I have tried changing every setting but nothing helps. The only thing I can do is create a new gdb every time but that is not the intention.I usually use the Insert and drop and create settings
Hi, I’m using FME 2024.1.I want to write xls files out where my field names appear in Column A (with their corresponding value pair in Column B) instead of in rows. Sounds simple, right?!Writing the data out with an Excel Writer produces a default output like this:Field Names in Row 1, values in the corresponding column....this doesn’t make for a particularly human-readable output when you have 250+ fields in the output dataset.This is the style I would like the output to be in:Field Names in Column A with matching values in Column B.I have tried using an AttributeExploder to create name:value pairs but am having trouble getting from there to anything particularly useable (I still have a lot to learn about working with lists). Oh, great hive mind, please help me out! Thanks, Casey
Hello : ) I have a Form workbench that first deletes some records from two tables in a geodatabase and then inserts new records into these tables in the geodatabase. This worked fine in FME 2021 but after upgrading to FME 2024 the delete creates a lock on the geodatabase and causes the process to fail: An error occurred while attempting to open an insert cursor on the table 'Total'. The error number from ArcObjects is: '-2147220947'. The error message from ArcObjects is: {Cannot acquire a lock.} Any advice on how to fix this problem would be great.
Hello FME Community,I am trying to convert annotations from a CAD (.DWG) file to a GIS (.GDB) file in the form of points, in such a way that each line of annotation text is a separate point with an attribute of this text. Everything seems to work fine in my workbench, however, after attaching to GIS programming and loading the resulting points, it turns out that in many cases additional points have been created in each line of text, which prevents me from using them correctly.Has anyone encountered something like this and would be able to help.I attach screenshots of sample annotations in AutoCAD and after conversion in GIS software.FME version: FME(R) 2023.2.1.0 (20240104 - Build 23774 - WIN64)
I’m fairly new to FME and I’m not sure this is possible. I’m attempting to add a MS Word doc. to multiple zip folders (from a fanout) that contain shapefiles. It’s basically a data dictionary that needs to accompany the shapefiles. Is this possible?
Hello, unfortunately I have repeatedly problem with exporting to Excel in Workspace. I checked log, there is following message: 2016-11-24 10:05:57| 67.6| 0.2|ERROR |Excel Writer: Failed to save changes to the spreadsheet 'D:\\XXX\\XXX\\XXX\\new.xlsx'. Check that you have write permission to the file, it has no password protection and is not opened by another application. Error message is 'Permission denied.'It looks, that there is error on Excel side, right? I just want to create new Excel file...
Hi all, I've got some confusing to clear, and hope to find an answer here. I have 2, completely the same datasets, uploaded to ArcGIS Online. Now, i want to update them. To test it, i took 2 completely identical layers, read them from AGOL and now, it shows differences. Can someone explain me what the problem is? If i only check on attributes, then there is nothing wrong, but if i also check on geometry, there is somewhere a change, and the Changedetector gives updates as output, but it should be unchanged. All the data is 2D, there is no 3D. In the update detection key attributes, i selected all the attributes, but left GlobalID and OBJECTID out of it. same for check attributes. Even more confusing, if i do the same process in a new workbench, with the same sources etc, i get different results. Sometimes it igeve met 900 updated, and somethimes 1322Thanks in advance!
Hi I am doing migration testing from 2023.1.2 and 2024.0.3. It seems to completely fails on 2024.1.I have tested it on 2023.1.2 and 2024.0.3, worked perfect - no issues.It fails on FME Flow and FME Form on the server - but works OK on my local PCon the server - oldeb 2019, clr 2019, are installed, as with .net 4.7, 4.8 andIt is just a simple sql server spatial reader - and a bit of reprojection - it fails on reading the reading the dataCheersRudy
I am trying to read an ALKIS data file coming as XML file. I have two files, the first one come with version 6.0 and FME opens this file without any problem (xmlns="http://www.adv-online.de/namespaces/adv/gid/6.0"). However, when i try to read the version 7.1 (xmlns="http://www.adv-online.de/namespaces/adv/gid/7.1") I got an error as following:XML Parser error: 'Error at file: 'K:\……..line: 1 column: 1 message: invalid document structure'An error occurred while attempting to parse the XML Schema document 'file:///K:/Geodaten/Projekte/ALKIS/2411_ALKIS_NAS/NAS-Operationen.xsd'The XML Module halted on error, see the logfile for detailsA fatal error has occurred. Check the logfile above for detailsFailed to specify the feature index as constraints on the readerFailed to obtain any schemas from reader 'NAS' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information do you have any so