Using readers and writers to extract and load data.
Recently active
Hi,I have a workspace with an Reader (SDE Connection) writing to multiple different zipped folders before a FileCopy Writer inserts a common disclaimer into each zipped folder. I want to use the FileCopy FeatureWriter due to the output port would then allow me to connect to a S3Uploader transformer and simplify my workspace down from 2 to 1.I however receive a error of: Cannot have multiple factories with the same name. Multiple factories were assigned the name 'filecopy_FeatureWriter-FileCopy_d4291b7d_cbed_4650_990f_3e25feda4a160'Am I missing some parameter setting or is there some workaround using the FileCopy Reader that allows processing after the disclaimer insertion?
Hi all,we are company that interested in using FME products. Main issue that we are blocked in current process is DEM generation. We compare results with Civil 3D and failed to tune FME workbench to get comparable quality. As I understood FME has only 2 settings for DEM interpolation: planar and constant. Planar gives us better results, but still interpolation doesn't seem good enough. It is not accurate. Ive attache some synthetic file that we use for quality assurance. And results from FME and Autocad Civil3D. Another question is what should be best input format for such operation, our pipeline set to work with 3d edges, but may be TIN would give better quality? May be anyone solved this task in the past to move process of DEM conversion of TIN from Civil3D to FME?Here is file that I am working with and results: files . Basically I dont understand why FME give so big difference in elevations and why it is not symmetrical for pyramids.
I have two files a csv file and an Excel file with 4 worksheets, I need to compare the two files to see if all records in the Excel file with all sheets are present in the csv file, there is a particular column in the Excel file, it is a string e.g. 'ff_abcd_12345', I need to get everything apart from the numbers from this and compare it to a field in the other file. There are thousands of records which need to be compared, all I need to do is check if the record exists and report it as matched or unmatched. Any ideas on how I deal with this will be much appreciated.
I have a workbench which writes individual objects to multi page PDF. The page number is defined using 'count' and assigning a 'group' which is then used after the PDF PageFormatter to specify 'pdf_page_number. However I now need to have 2 objects per page. Can anyone advise how I can group these automatically into groups of 2 to write per page?
I'm working with a client who has Bentley ProjectWise on-premise. We're trying to connect to that using the ProjectWiseConnector but we're having trouble figuring out the base url. pw:\\\\[servername]:[Repository] seems to work on the browser, but not in FME.Has anybody else done this before?
When trying to upsert a large dataset I get the following error: Socrata Writer: Failed to Execute `""C:\\Program Files\\FME\\jre\\bin\\java" -Xmx1g -jar "C:\\Program Files\\FME\\plugins\\socrata\\datasync.jar" -ph true -sc "C:\\Users\\dmingl\\AppData\\Local\\Temp\\FME_1533665505412_4848\\control.json" -i u8yq-kcrr -c "C:\\Users\\dmingl\\AppData\\Local\\Temp\\FME_1533665505412_4848\\config.json" --userAgent "FME/2016.7.23.16717" -f I'm using DataSync 1.7
Hello,I'm totally new to FME and learning from scratch and I've already did some coordinate system transformations (fomr xls to xls and dwg to dwg), but now I'm trying to transform a list of point from an excel file(name, x coordinate, y coordinate) into a dwg with a dwg template for the point name.Now the points creation is easy but the problem is with point name that should be as a "block reference", just like the one in the template.I'm not even sure if it DWGStyler is the right choice.Can anyone help me out?Thx.templateworkflow
Hi All, Does anyone know how to set the FORMAT for a Generic Writer at run-time? I have a generic reader and want to output to whatever format the input data was. Is there a good way to do this? I've tried getting the input fme_format_short_name and using that as an attribute, as well as OUT_FORMAT, OUTPUT, FORMAT, and OUTPUT_FORMAT. But all fail with the tautological: ERROR |Generic Writer: Cannot use the Generic writer to create a Generic writer. Please select a different writer for the FORMAT keyword. Thoughts? Thanks, Jonathan
Hi all, fairly new to FME and can't find much about this topic. I am using an FME workbench to move over a lot of data from an oracle database to a Microsoft SQL server. This is done by using a lot of SQL creators. It has been working fine but I think I have reached the limit of the Oracle I am using. My error is "did not succeed; error was `ORA-01000: maximum open cursors exceeded". I was trying to keep this all in one workbook - but I am not sure how with this error? I tried creating a separate database instance but that didn't work.
As beginner with FME, I try to read documents from MongoDB.As far I understand, as a defaut behavior, if an attribute is not detected in the first read documents, its reading will be skipped. Is there any way to avoid this behavior?Many thanks!
I am attempting to write from a WFS FeaturerReader directly to a FeatureWriter, using the tip outlined in this post:https://knowledge.safe.com/questions/69654/writing-table-with-featurereader-featurewriter-pro.htmlThis works for some datasets, but when I try to use a particular dataset, I get an error message:Bulk copy failed on table 'public.road_works_line_temp' using delimiter ':'. Error was 'ERROR: extra data after last expected column CONTEXT: COPY road_works_line_temp, line 1: "NULL:featureMembers:rwe_line.143236:143236:Sporting/social event:NULL: road closed:NULL:Pending:NULL..."'The wfs url is http://api.vicroads.vic.gov.au/vicroads/wfs?SERVICE=WFS&VERSION;=1.1.0&REQUEST;=GetCapabilities&AUTH;=eyJraWQiOiJRRFFQWDZVSDlQRExOOU9GQVowMlNFRFVYIiwic3R0IjoiYWNjZXNzIiwiYWxnIjoiSFMyNTYifQ.eyJqdGkiOiJuUzRMM0MzSURvdzRsakNNc3R2Y0IiLCJpYXQiOjE0OTE1Mzg2NDQsImlzcyI6Imh0dHBzOi8vYXBpLnN0b3JtcGF0aC5jb20vdjEvYXBwbGljYXRpb25zLzRBeTd5RjJtUUNpQlpxUHo5Q3lRVTgiLCJzdWIiOiJodHRwczovL2FwaS5z
Hello,I convert data in Geojson format to ESRI Geodatabase. I would like to add alias to each field. How to do ?
I've followed https://docs.safe.com/fme/html/FME_Server_Documentation/Content/AdminGuide/configuring_for_https.htm#EnableSSLWebSocketServerfor HTTPS, service URLs changed etc. When trying to create a websocket subscription under Notifications I get an error of "There was a problem communicating with the REST API" when I click validateFME seems to be running fine and I can query the REST API ok.Any ideas?
Hello,I have a problem with exporting dxf file. I use shp file reader to import polygons and i would like to export them to dxf format (dxf file will be used later in old version of GlobalMapper). I dont know how to export dxf with fill colors. Which writer should i use and which options must be selected to get polygons (not lines ) with fill color.
I am writing some geom to a KML file and wanting to group the data by Phasing. I have used the feature type name to identify the grouping. When it writes the KML the groups are shows as kml_id_doc_1.1.11.4kml_id_doc_1.1.11.5kml_id_doc_1.1.11.6Does anyone know what is going wrong and how I can fix it?Thanks
My workflow successfully read in the 600,000 dgn features, ran through a Matcher transformer to eliminate duplicates, was going through a featuremerger and geometry filter where it bombed as it was writing to shapefiles. The error - f_67(CreationFactory): Error - Number of measures found on the 'line/path' geometry did not match features number of coordinatesI have my Reader set to Master coordinate units. Has anyone seen this error and is there either a setting or some other filter/transformer that can be added to fix this?I'm reading MicroStation V8, processing in FME 2017
Hi!Working with Sentinel data, you get some 120 files i a zip file (standard download). Only three are needed to make an rgb image with FME (as described in this post: https://knowledge.safe.com/articles/43742/making-rgb-images-with-sentinel-data.html).This workspace snippet begins to extract these file names and should then pipe them to the next step (there is more to follow). But I am unable to figure out what goes into the gap between the TestFilter and the RasterBand... transformer. I simply need to get the path_windows attribute to be understood as an input file.
Hello y'all,I submitted a large international airport file to your online IMDF validation portal and I haven't received an error report yet, it has been over 45 mins since I submitted the file. I have uploaded a smaller file, and I received an error report. Is there a file size limit with the online validation? I appreciate any guidance! I am using FME Workbench 2018.1.Thank you!
I am creating a workbench to be uploaded to FME Server. As part of the workbench I want the user to be able to upload their own shapefile (Any shapefile, no restrictions.). How do I setup the user parameters to allow this to happen?Thanks for any help.B
Hi,I've developed a workflow to convert about 100 dgn files into mapinfo and cad formats. In essence I have a single merged .dgn reader. Each .dgn is read in and some geoprocessing happens to make layernames explicit and then a writeback happens. The issue is that the writeback will only happen once everything is read in. The output features are named based on the input file.For cad writeback using a fanout: @Value(fme_basename).dwgFor mapinfo writeback using TABLE NAME: LinearFeature_@Value(fme_basename)What I would like to happen is once the source dgn is read it gets written which should free up memory and hopfully speed up the process.This has sort of been asked before with write features as they are read from @mapper @david_r and also Write outputs before translation is complete from @jamiefinney and @redgeographicsHowever I am not sure how to implement the master-child pattern suggested by @redgeographics.Below is a screenshot of the workflow however in essence itsRead d
Hi,I have a list of lat/long points in a text file and I would like to see where they fall onto a map. Is it possible to plot them over an existing shp file? How would I do it?Thank you!
Dear community!First of all I've to say that I'm very new in the world of FME.I have the following problem with the conversion from a simple 2D point feature to a non-spatial pdf. I'm familiar with the transformers (PDFStyler, PDFPageFormatter) and the Adobe Geospatial PDF File - Writer which I need for my pdf output. But I've no idea how to extract the information (Atttributes) of the points and write it in a table or list (in an ordered way) in a PDF. My problem is that the attributes are distributed spatially (according to their actual location in the map) across the PDF output after the LabelPointReplacer.thx for your help
I have a large number (> 1000) of mapinfo files that I need to convert into an esri geodatabase but i do not know the geometry of each mapinfo tab or have the time to find out each.Is there a way to automatically convert to the correct geometry type when selecting folders of data?
Hello There we are using google Sheet reader, but when published on the FME server, we are getthing access error we tested the workspace on the server , its seems like it not even reaching the autentification page , I beleive its due to restriction on the server, what is the URL we should give the system admin to clear it Thanks
I have CSV file with x/y coordinates, text, text size, text angle. How can I convert is to a DWG file with text not points?