Using readers and writers to extract and load data.
Recently active
I'm attempting to write linear features to predefined levels with established byLevel characteristics such as line weight, line color, etc. Specific levels are being defined per feature via the igds_level_name attribute when writing to the DGN writer. The configuration of these levels is not established in the SEED file being referenced, but they are configured in a .dgnlib file. Does FME support the use of .dgnlib files?
Hi,I'm trying to write data into a PostGIS database. However, I get the following error:Bulk copy failed on table 'schemaname.dataset' * using delimiter ':'. Error was 'ERROR: value too long for type character varying(3)CONTEXT: COPY dataset, line linenumber, column columnname : "attributevalue"A fatal error has occurred. Check the logfile above for detailsBulk copy failed on table 'schemaname.dataset' using delimiter ':'. Error was 'no COPY in progressThe type character of the column is not set to have a width of only 3. But I keep getting this (or other similar errors).I have tried multiple things:- Using CSV instead of Excel as a datasource- Increasing the width of the attributes- Changing the type of the attributes ( text or string instead of varchar) of both the reader (input) and output (writer)With the Excel file I would get a similar error, but on a different column and line. with the CSV it gets stuck.I have to note that
Hello allHoping someone can help, i have a minecraft world created with FME, this world contains the Ground mesh.i now have the 3d geometry for the trees and buildings, i want to add this geometry into the exisiting minecraft world.Any ideas. Thank you
I installed AutoCAD 3D Map 2019 and FME Desktop 2018 Win 64 for a user this morning. He also uses Smallworld.He's getting this error message: "This FME edition does not recognize the `SWORLDSWAF' writer. Please ensure that the current platform supports this writer, the writer name is spelled correctly, and that you have installed all required plug-ins."Honestly, I know nothing about FME. I never even heard of it until this morning, so I'm reaching out for help. Is it possible that the server software (which I don't have access to) needs upgrading? Smallworld runs on Java, so could an old version of Java be the problem? I doubt he had a very old version though. The PC is running Windows 7 Pro 64 bit. Thank you.
Hi there.I was trying a simple task to download a csv file from S3 and convert to a shapefile. I could download files with S3 Downloader and narrowed down to my target CSV file with StringSearcher. Then, I used FeatureReader to read the target CSV but I couldn't bring any attributes in the CSV file with this process. I am hoping I expose all attributes including latitude and longitude. Then I want to generate geometries from those lat & long with all attributes.When I run the above workspace, then I got no attribute like below. The process itself was successful though.Here is my original CSV table I was working on.When I create a Creator---FeatureReader workflow with a local csv file, I didn't have any problem to include (expose) all attributes. Why I am missing all attributes when I download a csv file from S3 but didn't happen with a local csv file? What I am missing here??Please give me some advice!Thank you.@hirooimaki
FME Database EditionBuild: 18295OS:Microsoft Windows Server 2012 R2 StandardI am unable to connect to an instance of Microsoft SQL Server.Steps to reproduce:Tools> FME Options > Database Connections>click '+' buttonentered in all connection info for Microsoft SQL Serverusing windows authenticationWhen using Windows Authentication I receive the following error:Microsoft SQL Server Non-Spatial Reader: Connection failed. Connection string `Provider=SQLNCLI11;DataTypeCompatibility=80;Data Source=155.80.100.24 ;User ID=;Password=********'. Provider error `(-2147217843) Invalid authorization specification'On the same machine I am able to connect through ArcGIS Desktop using the same connection settings
I have city models in those formats, how to translate them to other format and to each other?And why on earth should FME leave some formats that can only be read or write, not both way?
I have Feature Reader that pulls tiff files, these are then passed on to the Geotiff writer. I now want the writer to write the tiffs, with the world files. I have selected within the writer to include world files but it is not working. I've uploaded the workspace. Thanks for any help.Bjudes
I am attempting to convert a DWG file to an ESRI Shapefile for use in Arcmap and ArcGIS online. The placement of the shapefiles seems to come out ok, however some of the geometry is missing. Just pieces of layers. An inspector was added to the workbench and the geometry looked just fine in it. This has been attempted in both 32 bit and 64 bit versions of workbench. Any suggestions would be much appreciated!!
Please help to visualize data from excel in ArcGIS shape files.(excel to polygon shapefile)Please see attachments.
Hi,I am not sure whether this is an FME issue or an ArcGIS Online one. But when writing to a ArcGIS Online Feature Service, writing fails if overwriting / updating a layer which has 'Time Enabled' within ArcGIS Online.If only the single time field is selected, it appears to work ok. If a start and end time are chosen, it doesn't. Citing the error:'addResults' error for a feature in 'Events'. The error code from the server was '1000' and the message was: 'The given key was not present in the dictionary.'It goes away if time is disabled again within the Service an AGOL.Any ideas would be greatly appreciated.Matt
What is, or is there, compatibility for FME Desktop and AutoCAD 2019 yet?
We currently have a single workbench stored in a central location being accessed and ran by various users, at various times. I would like to be able to incorporate the individuals system username into the log file name, as well as the date/time when they ran it. Is this possible?
Hi, I'm trying to write a landXML file for import in Civil3D. I have used the template from an old article that writes the metadata. I can get out a file that contains the geometry and the metadata but it won't load in Civil 3D. I have no idea how to get it to work and I have never found anyone that got it to work either in real life or on the internet. Why is documentation so scarce? It seems most people even from Safe only provides half answers on any of the prior threads on this issue. Thanks! /Jacob
Trying to convert the data from Access DB to Oracle non spatial tables. Column is number at writer but the values shows as double with precision values so data format voilation after conversion, Am i mssing any configurations? shows problem in detail.
I'm using a FeatureReader to read features from the WFS:https://geodata.nationaalgeoregister.nl/beta/bgt/wfs?request=getcapabilitiesWhen I read only one Feature Type, it works fine. But when I try to read more then one, the featyre is rejected. I now use multiple FeatureReaders, each of them reading 1 feature type, but my workbench gets very complex. Can somebody help me fix the problem?Thank you!
Hi,I'd like to update the attribute metadata of our feature classes in the ArcSDE Enterprise Geodatabase. The attribute names and descriptions are in an Excel-file. There is already existing metadata (e.g. a description of the feature class and publication date) that I would like to keep. So I want to update the existing metadata.For testing purposes I created attached workspace and Excel-file. I use an XSLTProcessor - and not an XMLUpdater - because the number of attributes may vary between feature classes.The XSLTProcessor needs a stylesheet as input. This stylesheet is dynamically created based upon the attribute information in the Excel-spreadsheet.When I select 'Attribute with stylesheet' as the Configuration Type and choose the dynamically created attribute 'stylesheet', the XSLTProcessor raises an error on execution: XML warning: Fatal Error: invalid document structure (Occurred in an unknown entity, at line 1, column 1.)XSLTProcessor(XSLTFactory): Unable to transform original d
I want to determine when a dwg file has a certain percentage of 3D Faces versus other solids. It doesn't appear GeometryValidator or GeometryFilter provide for this. Am I missing something there or is there another solution?Sometimes an input model may have cylindrical shapes comprised of 3D Faces around their perimeters and defining their end caps. They look okay to the eye but are horrible to process. Wanting to distinguish those flat 3D Faces (versus other solid primitive shapes).
Hi,I've been processing data and writing outputs to PostGres tables that are created by the writer. I've created a number of writer feature type by copying an existing feature type and renaming them. Every writer feature type has a unique name, followed by a parameter indicating the year. However, this seems to cause an issue where FME considers the copied + renamed feature type to be the same as the original on some level, and refuses to write to it.FME 2017.1 (build 17539) gives a somewhat vague warning about feature types but continues processing:2018-07-04 10:42:52| 102.1| 0.0|WARN |=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-2018-07-04 10:42:52| 102.1| 0.0|WARN | Features not written - verify feature type fanout/dynamic settings2018-07-04 10:42:52| 102.1| 0.0|WARN |=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-2018-07-04 10:42:52| 102.1| 0.0|WARN | (Check that fanout/dynamic feature type attribute exis
Hi,Is it possible to create normal/highlighted KML icons with KML FeatureWriters instead of the standard KML Writer shown in the FME example Here: I am exporting an entire SDE database to 6 different formats and used FeatureWriters to convert/insert a disclaimer into the zipped datasets. Thanks!
Hi all,I am a newer user to FME, and I am using FME Workbench 2017.0.I have a new feature class that has coded domains. The data being input into the new feature class is coming from a feature class in an old MDB. I would like to delete attribute values from each field that does not have values within their respective coded domains, and they can either be null or empty strings.The picture shows an example of some of the data where you can see BUR-T does not exist as a coded value in responsible_agency or maintained_by, but it exists in pipe_owner. Or STR does not exist as a coded value in pipe_owner or maintained_by, but it exists in responsible_agency. I used AttributeValueMapper to get to this point.Note: I have tried making a query to delete values with char_length < #, deleting uppercase values, and etc., and those did not seem to work because the 'Town of Burke' and 'Streets Division' values are still recognized as their codes, so they are subsequently deleted w
Hi,new here. Just want to ask how do I extract data from xml below into an Excel Table. Problem I specifically can't get over with is how to make the attribute name into a column heading in Excel and how to extract from inside the groups.Cheers.<?xml version="1.0" encoding="windows-1252" ?> <file name="EMP_RECORD" version="3.0.0"> <schema> <group name="EMP_RECORD_HOURS_DAY_DATE"> <field name="HOURS_DAY_DATE"> <desc>Effective Date</desc> <just>R</just> <len>12</len> <type>DATE</type> </field> <field name="HOURS_DAY_CODE"> <desc>Hours/Days Register</desc> <just>L</just> <len>2</len> <type>VARCHAR</type> </field> <field name="PAY_GROUP"> <desc>PAY_GROUP</desc> <just>L</just> <len>20</len> <type>VARCH
I have a folder that has approximately 50 XML files in it. Between one and three new XML files are added to the folder each day. Each of these files needs to be sent to an AWS S3 bucket. Ideally, every morning FME would scan the folder for new XML files and upload only the new files to the S3 bucket. Does anyone have an example workspace or best pracitces they can share? There seems to be many ways to do this, but I would love some guidance on the most efficient and reliable route. I have both FME Desktop and FME Server.Thanks!!
Hi, I am using the FME Server REST API and needing some guidance.I have a published workspace in FME Server and run daily via the scheduler to output a .json file on my FME Server. I am trying to call the data with the FME Server REST API to retrieve the .json file so that I can hand it over to our web developer for him to use for an application he wrote. I do not want the FME Server Job to run everytime an API call is made to get the .json file/data. I am new to using the FME Server REST API but have tried playing around with the API v3 GET GET /repositories/< repository >/items/< item >/datasets/< dtype > Can someone please help me to get on the right track on using FME server to get my data via an API call/URL?Thanks!
Hi everyone, I hope my question will be clear to understand. I have a workspace that generates a single list CSV of photos from multiple tables in a Postgres database, each with a UUID to identify it in the bucket. It looks like this: This list is output to the (FME_SHAREDRESOURCE_DATA) directory on FME Server, which I then want to call it from and use to parse the photos from the S3 bucket and move them to another S3 bucket. I need to use the Cloud/Server resources as the total size of these photos can reach multiple GB’s and would cause too much latency on my office WAN. How can I achieve this using the S3 transformers offered with FME to move objects between S3 buckets without downloading the photos locally? Or is this even possible in a single or multiple workspace(s)? I would also need to perform this on video files as well. Thanks in advance for the assistance. Todd