Using readers and writers to extract and load data.
Recently active
Hi, I am trying to read some data that is stored in several subfolders in the FME share resource data folder. It seems like the process didn't like the wild card ie.. Data\\foldername\\**\\*.csvAny pointers/ work arounds?Thank you in advanced for any help you can provide.
I am new to FME. Although I can deduce how to use @value(Attribute) in a text editor in the workspace, I am not sure how the $ symbol is used and how it can be chained to say @value. Also are there other keywords with the @ symbol. Where in the documentation are all these symbols and their usage comprehensively defined and illustrated? Thanks.
It seems like core isn’t starting because the web interface is complaining about not being able to connect to core and running `sudo ./startServer.sh` results in this error: ```Cannot open log file /opt/fmeserver/resources/logs/core/current/fmeprocessmonitorcore.log for writing, defaulting to standard error output```
Hi Everyone,I am writing to the AVF writer and then using the AVF reader in separate workbench. However, I noticed that there are two different naming conventions for Level _Ids under Sections category. See attached pictures. Is there a reason why they are different? I know that in the AVF Writer, it is a list, but the AVF Reader does not show it as a list. When I run the AVF reader in my workbench, level_id does not exist. I am using FME 2018. Thanks!David
Hi Guys,Did any one tried converting DRW files to DWG/DXF?Pratap
If we use a shape file reader in FME desktop we only need to pick the shp-file but not the other parts like dbf, shx etc. FME desktop recognizes all parts of the shape file and we can start our workflow.If we publish the same workspace to the server and use a published parameter for the shape file then we need to upload all parts of the shape file as a temporary data upload to FME server. If one of the parts is missing then our workflow will not run. How can we check (in advance?) if all necessary parts of a shape file were temporary uploaded to FME server?Best regards,Frank
Hello,I have a DGN file (Microstation v8) which stores spatial data elements (elements with XY coordinates). The elements are linked to an external database. I need to export the data from DGN file and join the exported data with its associated data in external database. I am using FME workbench with reader format as "Bentley MicroStation Design (V8)" and writer format as GeoJSON.When I redirect my output to FME data inspector, I see the linkage data in a field called "igds_linkage{0}.blob (encoded: fme-binary)". Sample value for this field is E06E00000000000000000000. The actual link value in the external database for this element is 28384 which is 6EE0 in Hex. I can get the same value by swapping the first two bytes of igds_linkage data i.e. from E06E to 6EE0.Now, my issue is that this data is visible in data inspector only. How do I export it into my output GeoJSON file?The field "igds_linkage{0}.blob" is a Format attribute of type char(255). I've c
In this drawing there is a block named:'Verkeerssignalering Mantelbuis (Lusconfiguratie)'How do I get this exposed in my FME Workbench? I have tried exploding, not exploding, merging exploded to not exploded etc.
Hi all.I've got a tab file that I run a few queries against it to pull out some values which based on a published parameter used for the query. The results are then written into an Excel tableIn this case the publish parameter ‘LEASE NAME’ used in the query has extracted the Collingwood 3 data from dataset. Seven records were extracted however I’d like to make those into a single record that contains data from each attribute where present. Additional I want to sum the values in the length columns.At the moment it looks like this.But I want it to look like this.What should I be doing to get this result? Thanks a heapMichael
I'm starting with background color as a test, since it takes html I thought this would change the balloon BG color but it's not working. <html> <body bgcolor="#E6E6FA"> <img src="https://seamlessrnc.nauticalcharts.noaa.gov/rnc/noaa_ocs_small_banner.jpg"></a> <BalloonBGColor = '-1' BalloonFGColor = '-16777216' BalloonBGColorField = ''red" > </body> </html>
How can I Convert an esri feature class to a KML and assign colors based on the attributes in the feature class I have some line feature classes (roads) which have a condition rating and a color based on that rating. i would like to convert these feature classes to KML and assign them colors based on the condition rating.
I get the following error when trying to access a Pervasive SQL databaseStarting translation... FME 2018.0.0.0 (20180308 - Build 18284 - WIN32) FME Database Edition (node locked-crc) Temporary License: 16 days left. Machine host name is: cmcclain Operating System: Microsoft Windows 10 64-bit (Build 16299) Copyright (c) 1994 - 2018, Safe Software Inc. Safe Software Inc.Creating reader for format: Pervasive PSQLTrying to find a DYNAMIC plugin for reader named `PERVASIVE'Loaded module 'PERVASIVE' from file 'C:\\apps\\FME\\plugins/FME_ADO.dll'FME API version of module 'PERVASIVE' matches current internal version (3.8 20180209)Pervasive Reader: Read 0 DEF line(s). Found 0 attribute(s)Pervasive Reader: Opening `mcsdb' for read operationPervasive Reader: Connection failed. Connection string `Provider=MSDASQL;DSN=mcsdb'.
I am trying to create a database connection to a SQL Server Express instance on an in network server, but I'm not having much luck. I have made sure the TCP/IP is enabled, the TCP Port is set to 1434, TCP Dynamic Port is empty (I have tried multiple options there as well). The SQL Server Browser service is running. I have restarted the SQL Server service. I am able to ping the server. Does anyone have any other suggestions to try. This is the error I receive. Thank you!
I am migrating from FME 2014 to FME2017x64. We have been using a workbench for some time in which the output includes writing to a number of excel template worksheets having defined ranges for the writer. In each case the option to truncate the range has been set to yes. When running the same workbench in 2017x64 I am now seeing that some worksheets/ranges are getting populated while the vast majority are not . I've been looking for something that indicates why some would get populated while others would not but have not been able to determine what that might be. Has anyone else experienced problems with excel writer in FME 2017 not writing to worksheet/ranges as they had in a previous version?
Hi All,I am trying to get the center point of a room without replacing the geometry, i.e using the center point replacer. When I use the Center Point Extractor to get the center point lat and long, the lat and long ends up in South America. I'm confused because the Revit file displays in Texas, which is correct. Can anyone help explain this?I am using the IFC reader to run the Revit file. The RefLat and Long are in Texas. Can this be caused by the Revit file Min and Max Reference coordinates? I'm thinking the vertices in the Revit file are not correct. I do not know Revit unfortunately, I only receive these files. If there something wrong with the file, or something that the Revit Technicians should fix, that would be great to know and understand. Any insight would be great!Thanks,David
AutoCAD DXF files created by FME are larger than those produced by other software packages. How we can reduce that. I have many dwg files to convert to DXF. Thank you
Hi all,I’ve a question regarding single sign on into FME Server.I’ve installed FME Server on a domain (let’s call it “Domain A”) and I’ve configured the SSO for the users in the Domain A. I’ve tried to log in on a client using right domain A account and then, using Internet Explorer, I’ve logged into FME Server in SSO mode and It works fine.Now I have another domain (let’s call it “Domain B”) trusted with Domain A in bidirectional mode.In FME Server I added the connection to the Domain B’s Active Directory and imported the users from this domain.I tried to log in on a client using right Domain B account and then, using Internet Explorer, I logged into FME Server in SSO mode but it not works.The returned message is “You are not authorized to access this web application”Can someone tell me if I need to set principal name, using the setspn command, also in the Domain B?Thanks in advanceRoberto
We have a migration project kicking off and the team here is already using fme for Documentum. I want to know if the tool has the capability to perform a migration from Documentum to SharePoint Online whilst maintaining metadata and structure from the source.
Hi ! I have a problem with Autocad extended data. I added a "data property set" in my ACAD file with an attribute named "UAID". I found it in my extended data properties on Autocad.I would like to find it when in FME in order to write in the "UAID" field a unique number that is read from an Excel. I don't know where can I find the UAID, can anyone help me ?
Guys,something wrong is going on. I was changing existing working workspace to pointing to new geodatabase zip file, which also has new table structure. Modified new workspace is working fine on my PC under FME Workbench. But if I publish it on FME Server I'm getting the error (see below) for each attribute that we are not reading from geo tables. And since original database is huge after few minutes FME Server stops the job without any failure message and building core dump files on FME Server machine.Error messages that we are getting:Geodatabase Error (-2147467259): General function failure. Could not read Field `column_name' in Table `Table_name'Does somebody know where the issue can be?Appreciate any help!Thanks.
I am writing a CityGML file by reading the LOD2 3D building models from the DGN file.While reading the DGN, grouped holes are exploded, i.e. “Expand Unnamed (Group Hole) Cells: Yes” and then DonutBuilder is used to re-build the required geometry, i.e. grouped holes. However, rebuilding the grouped holes with the DonutBuilder for the polygons at different heights does not work properly and seems to randomly assign the Z from either the top or bottom or some from bottom and some from top. Please see screen grabs below showing building superstructures:The part that re-builds polygon cutouts is as follows: I used the Group By: “igds_cell_name_sequence_number” from the original DGN grouped hole cells that got expanded when read in order to rebuild them again with DonutBuilder. I tried different Z Modes but it did not help to prevent from incorrect group hole building It seems to be random, in some cases it will built a correct geometry, in other, it will do the incorrect “unexpected” geomet
Hello,I am trying to work with data from OpenStreetMap, and I have an issue with retrieving tags. The only tags I get are the ones related to 1st level types. Other attributes appear in the inspector right panel, but I cannot access it from in my workflow. So what is the difference between attributes from the Table View and the Feature Information ? Is there any way to access those specific features information from the Workbench ? Strangely enough, when I check the "Determine feature by scanning the entire dataset", all tags also appears in the Inspector Table View (with a lot of missing values). But I cannot use that option from my main workflow, as my dataset is an URL (returning an OSM XML file). So far, I am only looking for a few attibutes on a few elements, like the "layer" value for highways (which indicates if they are underground and above or below other highways). Any help would be much appreciated, as this is very important for my work :)
I'm struggling to transform some pdfs. I am using the PDFtoTEXT transformer as well as a textwriter, stringsearcher, maybe calling to python, and then writing it to a database. I'm flummoxed at the first step.Sometimes it'll write a pdf to a textfile. But often the pdf2text program box pops up. That's useless for automation. What I want is for it to read a whole folder of texts - found the place to specify that - and process each of them into a complex row in my database with many different values. The pdf contains a couple values in the headers and many more in a table-like layout. I will need a couple string parsing processes to get through all that. No idea how to get it to read the pdf name and put that in one cell in my db.But the data inspectors are useless. The interface says the transformation was successful - but nothing was written to the output.txt.So - issues:- how to process multiple texts- how to see what's going on so I know it's working properly
How do I create a working .dwg file from a paper copy of a drawing that I scanned and saved as a PDF?