Using readers and writers to extract and load data.
Recently active
Seeking help,I have an IFC file containing information about sewage pipes. In theory, it should contain two types of object classes (with geometry), namely IfcDistributionChamberElement (Manhole) and IfcPipeSegment (pipe). These classes use their subclasses as connectors, namely IfcDistributionPort (at each object node). Finally, these IfcDistributionPorts should be connected to each other using a relationship class called IfcRelConnectsPorts. My problem is that when I import the IFC file as a reader, the class IfcRelConnectsPorts cannot be found, which prevents me from establishing connections between manholes and pipes. Here is a screenshot. in IFC file (open by notepad) Here is a screenshot. fme dont hv any feature or attribute name IfcRelConnectsPort.
I have an FME 2020 workspace with an MS Access reader in it. MS Access 2013 Runtime is installed on my laptop. The workspace runs correctly. I have two FME Server/Form environments (2020 and 2023) with MS Access 2019 Runtime installed on them. The workspace will not run on either of them. 2020 FME Server wants the MS Access 2013 Runtime installed ("ADO Provider not installed or not compatible with FME architecture. Try installing Microsoft Access 2013 Runtime (x64)"). 2023 FME Flow wants the MS Access 2016 Runtime installed ("ADO Provider not installed or not compatible with FME architecture. Try installing Microsoft Access 2016 Runtime (x64)"). Is that because those versions of FME Server/Flow only work with those versions of MS Access Runtime? Or, is the MS Access Runtime info embedded in the FME workspace and I should install MS Access Runtime 2019 on the my laptop to work with either version of FME Server/Form? Bottom line is I would like to run the workspace o
Hello,I have a SalesForce account that is working but for somehow I'm not able to read data with FME.When setting my account, it was first asking me my username and my password After fixing this, now I'm not being able to create the web coinnection for Saleforces. I'm only receiving the following error message . I went to manage web connection and tried to test the web service for Saleforces but still the same error.Any ideas?
Feature cache works great as a method to inspect all transformers after a workbench has ran, but causes a few issues for me.it hurts performance to cache each and every transformerI lose all the cached data if FME crashes or I close the workbench.I am looking for advice on ways to cache or otherwise save output from only a few transformers. My only idea is to write features out to a file, and later bring back in with a writer. are there other transformers I may not be aware of that can save/recall data after restarting the workbench?
Is it possible to restore the cached data from a ran workbench that has been closed or crashed? I am running a heavy dataset (10s of millions of features) and it takes several hours to run. As I troubleshoot the workbench after, I am bouncing around between the cached inspectors for each transformer. My workbench has been crashing often in this process, and I wish I could re-open it and get back to the full cached state without having to re-run it.
I would like to write features to a local file to read back in later and looking for the best file type for performance.My local machine does not have any DBs to use for this purpose (Oracle, SQL, etc)so I am limited to files I can save to a PC folder.Does FME have it's own DB file type that I could be utilizing? I tried FME Feature Store (FFS) but it has limited functionality, such as not being able to set truncate or table drop on runs. And it's main purpose is to add encryption which I don't need and seems like it hurts performance.I have read on here that CSV is very high performance but I don't want to lose metadata such as data type, len, etc.Excel has a feature limit that does not work for me.
Does any one know how to read the latest file from a One Drive folder. I'm able to select a file from the One Drive folder using a Microsoft OneDrive (Graph) web connection, but I can't find a way to read all the files in the folder and then find the latest. I have read the question regarding reading the newest file for a folder https://knowledge.safe.com/questions/65203/read-only-the-newest-file-from-a-directory.html. It's very helpful condeptually. I would appreciate an thoughts or insight. Thanks,Frank
I am using the feature writer to write new column into a geopackage database. Instead of using the default geom I need to change the name to Geometry, but the writer does not seem to accept the spatial column to have uppercase characters?When I specify the spatial column to be called Geometry it is being writter as geometry in the table. Any ideas how it can be solved?
Good morning!I need to call a stored procedure of DB2 from FME. If I use the IBM Data Studio this script works fine:CALL TESTING.TEST_PROCEDURE('input1','input2',?,?,?,?,?);It has 2 input parameters and 5 output parameters.But when I use the same script in the SQLCreator of FME i always get this error: Literal replacement parsing failed for procedure call to DB2 for z/OS. Failing SQL text {my_script}. ERRORCODE=-4463, SQLSTATE=42601 Does anyone have any experience calling DB2 stored procedures in FME? Any help would be appreciated.I'm using FME 2021.1.
Helllo everyone, I´m quite struggling about loading files to MS Sharepoint on-premise. I´ve found some tutorials, but just for Sharepoint Online. Any ideas please?Lubo
Hello, I am exporting data to kml and in the placemarks list, an html table is included.I would like to have only the placemarks listed without the html table preview. Here is an example: What I would like to get is this:Would anybody have experienced this and know how to sort it out and make it look like the second one ? Thanks,Best regards,Thomas
I created a workbench that reads attachments of AGOL feature layers and write them into a GDB. The scripts works fine for features with one attachment. However, when a feature contains multiple feature, it's only reading one in my script. Does anyone know which setting I have to set, to read all attachments for every feature?
I am interested in read several .dbs files with FME. I have read that this .dbs is a Gupta Technologies SQLBase database file.Is there any chance that FME can read this format?
Hello all, I've been trying to delete a folder containing some data after processing. I cannot use a temp folder so have turned to python to complete the task.I've tried following the comments in the following thread but it doesn't seem to work for me File Copy - DELETE (safe.com)I can get the process to work when 'hard coding' as shown below. But when I try to make it dynamic by replacing 'location' with feature.getAttribute('filepath') and dir with feature.getAttribute('directory') it fails.The filepath and directory attributes are shown below:'filepath' = C:\\Project\\FME\\processing\\data'directory' = 20230925
Hello everyone!We have a file format that we work with, which is used by our engineering world to create bills of quantities for engineering projects.The name of the format is SKN, and in fact it is very similar to csv/excle,Is there a way I can just read it and put it in my workflow?I am attaching an example of the file here (zipped)Thank you!
How do we read AGOL relationship classes/related tables in FME? The published table can be imported separately but the relationship linkage is not maintained in the parent feature service. Is there a way to import feature service in a way from where the related table is linked?
I am reading into my workbench both dwg and dgn files using two feature readers. I am able to expose the fme_dataset for the dgn file by using an attributeExposer transformer, but the fme_dataset will not be exposed for the dwg files. I am able to get the fme_feature_type and fme_text_string for each FeatureReader. But I want to add the file name (fme_basename) as an attribute to each feature so I know what file it came from. Things I have tried:separate AttributeExposer transformers for each FeatureReaderThe same AttributeExposer transformers for both FeatureReadersAdding fme_basename to the <Generic> Port, along with $(SourceDataset_DWG)checking all of the needed options in Reader > Parameters > Schema AttributesWhen I open the inspector after the Exposer, all of the attribute fields are there but the values are empty. All of this information (file name, project name) comes from published user parameters. How can I add the value for these user parameters into my features
Hello!I know there are quite a few posts on the subject, but despite everything, I could not apply the solutions to my information.I have a worksheet that produces an ffs file for me, attached, (I changed the names in Hebrew to letters and numbers..)The file represents a neighborhood by type of consumption and amount of water consumed in it.my output is this: How can I Transpose it into this:(The number 1288.64 as a generic representative of consumption..)I would really appreciate your help!The excel file here represents an idea, at the end I write the FFS file for other formats..
In the UK we are able to download energy performance certificates from the following government website. Energy Performance of Buildings Data England and Wales (opendatacommunities.org)Unfortunately you need to register to gain access but its very straightforward.Within there is access to an api, which I have tried to use within FME to automate the downloading of these certificates for a local authority area, but always get a failure.Can anyone else connect to this API and download certificates and if so how. Sorry i cant paste the API but it changes for each user... Regards
I'm looking for some help with creating a Bridge in CityGML with two BridgeParts. Those BridgeParts can consists of one or more other objecttypes like BridgeConstructionElements. I've tried many things, but I can not figure out how to create the hierarchy of all the components in CityGML...Of course using the gml_id and gml_parent_id to connect elements, but unfortunately this somehow doesn't work out the right way. Anyone ?Like to share the final solution! What I like to see is a hierarchy:one bridgeconsists of two bridgepartswhereas different bridge elements like constructionelements can be found in both 'bridge' and the two bridgeparts So, something like this (simplified of course):<Bridge gml_id: BRIDGE> Bridgepart gml_id = part_1 gml_parent_id = BRIDGE BridgeConstructionElement gml_id = 563456 gml_parent_id = part_1 BridgeConstructionElement gml_id = 373648 gml_parent_id = part_1 BridgeConstructionElement gml_id = 238656 gml_parent_id = part_1 BridgePart gml_id = p
I have a LAS point cloud dataset that i want to urn into a nice mesh surface,the area is 1kmx1km. it has some high-rise buildings. using the workflow below. I've tried thinning the point cloud and ive also tried playing with the parameters in the TIN generator but it doesn't come through very nicely. any advice? I was thinking it ditch FME and use something else for this conversion?iwould like to use this mesh in unreal engine if the conversion goes well
Hi, I'm trying to dynamically write some features to a Geopackage, but constantly get the error `OGCGEOPACKAGE writer: OGCGEOPACKAGE writer: For feature type 'd_y_n', primary key attribute 'fid' has unsupported type 'mediumint'. Primary key must have type 'int'`. I'm reading the schema and features with a FeatureReader, from a PostGIS database. Dynamic writers for other formats seem to be working fine (obviously not tried them all!). And I've tried manually changing the schema in the workbench (by altering the native type attribute), which also doesn't work. If I manually set the output schema it works, but I can't do that... Any ideas how I could resolve this issue? (Using FME 2021.2 on MacOS)
say I have a GDB, with a feature dataset fruit (gdb) apples (feature dataset)coreslicesusing the schema reader, how can I expose the feature dataset name of apples?exposing all of the attributes in schema reader will not expose the name of the actual feature dataset within apples. I can get all the other attributes using list exploder.but can't get the feature dataset name.anyone know how?
I've built an AutoCAD based automation in FME Form and use blocks with text for some of the output features. The text aligns how it was designed in the block in the FME Form output. However, when running in FME Flow the text shifts.If I move the block slightly, select Reset Bl;ock or edit the text in AutoCAD then it snaps back to the correctly designed position.I'm using the same template dwg in FME Form and FME Flow.
I would like to integrate and automatize Primavera data in FME.I don't see any reader that accept primavera.How should I proceed to reach my goal?