Using readers and writers to extract and load data.
Recently active
I have an ODBC connection to a table that geocodes addresses and writes it to an ESRI ArcSDE feature class. When I run my workspace on my desktop everything works fine, as soon as I upload it to my FME Server I get this error: Database Error Message: [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified It's a System DNS connection and I checked all the drivers and 32bit connections and everything is good. So not sure what is causing it not to work on the FME Server. Thanks!
Hi, Say I have a massive table (+15million lines) with multiple columns , it has a Field called "category"..the category Field has multiple data values in it. how do i split the table based on the field category? say the field has 150 categories in it..therefore I need to have 150 tables. so if the input is 1 csv file.. the output required is 150 csv files separated per category. I think this could be a test filter with so many filters in it. thanks in advance. kind regards, Jubert
Hi, I create a MapInfo to CSV just to get a feel of how to use FME WorkspaceRunner, I tried to imitate the example: https://knowledge.safe.com/articles/Samples_and_Demos/WorkspaceRunner#toc1 which was provided in the Documentation however I am quite wondering how it works. I have 30 mapinfo files (on my target application could be 20k++ files) so when I run the normal mapinfo to csv it goes normally as below: however, when I run using the workspace runner, I get 4 times the number of files i had previously. why is this so? thanks in Advance. kind regards, Jubert
I am reading from a shapefile into a Python caller and get this error message: Attribute value of 'DESCRIPT' could not be converted to Unicode using attribute's encoding of 'utf-8' This error occurs at this line: feature.getAttribute("DESCRIPT")).strip() I have used the Python shapefile module in a standalone Python script to isolate the offending character. It is the hyphen in this string: 200 Block of W Georgia - In my standalone Python script I can convert the hyphen by converting from its Unicode number to a Window hyphen, like this: 0x96:'-' However, the exception is raised in the FME Python Caller in the line above before it gets to my conversion function. This happens with FME 2015, not FME 2011. Is there any workaround? Thanks
Hi guys, I am currently creating a 3D model for a drainage run, As they tend to be quite simple, I am using FME to do it. I have all of he information saved in .csv files (Manhole Co-ordinates, Manhole Cover Levels, Pipe Levels, Pipe Diameters etc.) Now, I have modelled the pipes just fine by using a point connector to connect the manholes with the same pipe attricute and then 3d buffering the line by the radius of the pipe, but, the manholes are a different question, as they are being modelled as Cuboids. With the cover level being the top face, and the bottom of the pit being the bottom face. In this site we have basically a different chamber depth for every manhole, and about 10 different cover sizes, so, inserting 3D Cuboid Cells/Blocks is out of the question. The only way I can get this to work is to offset vertices from the centre of the manhole cover, connect the lines using a point connector, and then extrude them to become the faces of the cuboid and aggregate them. Of course
Hello, is there a way to convert polygonal entity (geometry) into a surface or mesh or face? thank you
How one can control the order of reading of multiple feature types in one PostgreSQL/Postgis reader so you take advantage of Supliers first , Areas first , Candidates first and so on First ??
Hi all, If I have GML file (utf-8 encoding) with (e.g.) LATIN SMALL LETTER C WITH ACUTE which I want to insert into SQL Server table with SQL_Latin1_General_CP1_CI_AS collation, and want to be able to export that (imported) value from table to gml file, what should I do? I tried text encoders/decoders, but without success.
Hi! I'm trying to add an Interoperability Connection to an Oracle database(Oracle Locator) using Oracle Spatial Relational Format and I get this error:Error connecting to Oracle database: message was `ORA-01017: invalid username/password; logon denied'. (serverType=`ORACLE8', serverName=`instance/database', userName=`user', password=`***', dbname=`') Otherwise, if I choose Oracle Spatial format, I manage to connect with the same user and password but the data I retreive is incomplete. Does anyone encountered this problem?There is something that I'm missing? Thank you! R
Hi, I have a Microstation V8 DGN file with Curves. I want to convert these curves to points but maintain the same number and position of the vertices as they are in Microstation. When I use the "Chopper" transformer with number of vertices set to 1 (since I want points) it seems to create a lot more points than there are vertices in the original file. Any ideas? Thanks,
Hi there Community, I'm trying to fanout GML files into multiple ZIP files, where the GML file always has the same name but the ZIP file name is controlled by an attribute. So I want: test.gml\\North.zip test.gml\\South.zip test.gml\\East.zip test.gml\\West.zip It appears that the fanout dataset capability doesn't allow me to do this and I can only create many differently named GML files in the same ZIP. Does anyone know a way around this? Thanks in advance, Dave
Hi all, At the moment, I have workspace using XMLTemplater to make desired GML, and after that sending it to text writer to write a file. I saw that there is GML writer that supports user specified schemas. Does someone has an workbench example using this writer? I want to read data from SQL Server Non-Spatial stored procedures and, after transforming them, write them into GML file. Thanks!
Hi All, I was wondering if anybody has any experience with changing the font type in the example ws (https://knowledge.safe.com/articles/Samples_and_Demos/Write-Microsoft-Word-docx-with-FME) When examining the result docx I can see different font types created, but cant find how to set/change them. Any help would be appreciated. Itay
Hi people, me again, Why FME's SQL Server Non-Spatial Writer does't see column's default contraints? My table has column that is neither unique nor primary nor nillable, but has default constraint. In my workflow I'm not specifying any value (in some cases) to that columns, because I intend to use that default value. Thing is that FME doesn't write any row to that table because of missing value. What is going on?
Hi, I have a spatial dataset as shape file (.shp) and need to convert it into an XML file. Can we do that in FME?
I am having trouble reading data from a sde table with versioning enabled. Since archiving has been enabled the data I want is in a view. I can see the view in the table list but the reader fails to be created I get the error "Error while retrieving layer info structure for layer 'shape' in table 'ACCESS_BRIDGE_PT_EVW'.:SDE_ERROR_CODE(-20) Layer not found". I thought I might be able to create a reader for the base table and filter based on the esri managed field gdb_to_date. But that field is not exposed in the workbench. Anyone have experience reading data from sde with archiving enabled? My sde is using postgresql/postgis as the backend DB
Hi all, Is there a possibilty to write geodesic Data to an AIXM Writer? Now I use the GeometryPropertySetter Transformer, but it creates a LinearRing instead of a GeodesicString. I found an entry in the fme wiki about geometry builders: xml-geodesic-string (http://docs.safe.com/fme/2013/html/FME_ReadersWriters/Default.htm#xml/xml_geodesic_string.htm): is non-composite builder that interpolates a sequence of geodesic control points into a line geometry. (Built-In Geometry Builder (http://docs.safe.com/fme/html/FME_ReadersWriters/FME_Readers_Writers.htm#xml/built_in_geometry_builde.htm%3FTocPath%3DFME%2520Readers%2520and%2520Writers%7CXML%2520%28Extensible%2520Markup%2520Language%29%2520Reader%252FWriter%7CxfMap%7CFeature%2520Mapping%2520Rules%7CBuilt-in%2520Geometry%2520Builders%7C_____0" target="_blank)) But I don't get how to activate the geodesic geometry builder. Thanks, Mel
Hello! I was wondering if it's possible to create a standard text above the different attributes in excel or csv files? Here's an example of how it should look like. Two rows is standard and the attribute names will start at row four. Thank you!
Good morning, I have lease shapefiles we receive from a company (numerous leases for each county). So for example if I have 3 counties already in an existing geodatabase, those counties for this example are named Harris County, Thomas County, and Johnson County. If the shapefile the company has provided has Johnson and Thomas counties (No Harris County data), I will want to delete all records with Johnson County and Thomas County from the existing geodatabase ... and replace them with the Johnson and Thomas County data from the shapefile. But here's the kicker, I want to keep all existing Harris County leases in the geodatabase. A truncate will not work because I want those existing Harris County leases. Here's what would happen in a perfect world. Again this is just me dreaming and I'm asking all of you if this dream can be a reality. Step 1: Get a list of what counties are in the incoming shapefile (Johnson and Thomas) Step 2: Delete all records in the geodatabase tha
Hi, I am reading a Oracle SQL file and writting it to EXCEL. My SQL file give me a value of 100.893657 and When I write that to EXCEL file it just writes 100 Or even writing to inspector it gives 100. Is there a way I can tell FME to write the way it appears 100.893657.
Hi The Swedish Geological Survey (SGU) has been starting to share some of it's data as open data. Unfortunately some of the data is presented in JSON format, which I'm not fimiliar with. As I have understood it really is just a text format with georeferences. I would like to convert the files from JSON to SHP. The JSON-files can be found here http://resource.sgu.se/oppnadata/grundvatten/api/grundvattenforekomster/forekomster/2?vattenmyndighet=VH If you could point me in the right direction to start convering them with FME I would be very happy. BR Rob
I have FME Desktop Professional Edition 2015.0 (64-bit) installed and am trying to read an ESRI Personal Geodatabase (.mdb), but it is not available as one of my Reader formats. Am I understanding correctly from this page that I cannot, whilst the 32-bit version can: https://knowledge.safe.com/articles/Samples_and_Demos/Notes-on-FME-and-ESRI-Versions-and-Compatibility#toc5 ? Is there some other way I can read an ESRI Personal Geodatabase (.mdb) using my version of FME, e.g. by downloadable plugin?
Hi everyone! I have a simple workspace that I published to FME Server Jobsubmitter: it reads a textfile from a shared UNC path and logs each line. I have configured a specific user FME_Server_User that starts my serverjobs. If I log in as FME_Server to the server, I can access the specified folder and file and modify it or whatever. I can also run the workbench in FME Desktop without a problem. As soon as I start the job from FME Server Repository GUI, it fails. I get following error: Text File Reader: Source dataset '\\\\shared\\test.txt' does not exist A fatal error has occurred. Check the logfile above for details. The problem occures in a newly created folder on the share. The old folders still work just fine with the same setup (FME_Server_User etc.). Thank you very much for your help!
Hi! I have perused the questions pertaining to ArcGIS licensing here on these premises. However, I am unable to find a way to point FME to use a certain ArcGIS license server. The licensing solutions only talk about setting the ArcGIS license level, not the server. It seems as if FME Desktop can only use the ArcGIS license currently available for an ArcGIS installation on the local machine. Is it not possible to run FME standalone, and point it to a valid ArcGIS license server for ESRI-specific formats?
Hi all, I am trying to produce a WMS output from a shapefile input. I have the writer writing the data to PNG output, however it loses its projection information so if you go to view the WMS in ArcMap (for example) it won't show on the mapas it has no projection. Any suggestions would be much appreciated. Thanks