Using readers and writers to extract and load data.
Recently active
Accessing published workbench from client machine, I have published simple workbench that converts CAD files to shape files but couldn’t figure out how this workbench can be used from the client side. The link below doesn’t work from the client side http://10.110.62.82:8080/fmedatastreaming/Samples/CAD_TO_Shape.fmw?SourceDataset_GENERIC=%24(FME_MF_DIR)Ayman_02.dwg&FEATURE_TYPES=Parcels_Geometry&DestDataset_SHAPE=D%3A%5CS1 What might be the issue here? Thank you Best Jamal
The ArcGIS FME keeps the old local IP, We have switched the local IP to real IP. It appears that the FME Servers still generating URLs with the Local IP. What might be the issue here? How to set the FME Server to generate URLs with the Real IP? Thank you Best Jamal
Is there a way to connect to a Postgre server using an SSL connection? Thanks, Greg
I am trying to query more than 1000 records from a public, online ArcGIS Feature Server. I've used the help reference showing the way to use the ESRIJSON query method here (http://fmepedia.safe.com/articles/How_To/How-to-read-data-from-an-ArcGIS-Feature-Server-with-FME), but all the documentation I can find says that the limitation from ArcGIS server is limited to returning 1000 features. Note, I was successful in pulling using the ESRI-JSON reader in FME to create the first 1000 features. My web services knowledge is a little weak and I'm wondering if someone knows how to loop/iterate the request to keep returning more than the 1000 records?
I am writing to the esri Canadian Municipal Data Model (geodatabase) and cannot get the attributes I added to user attributes to write to the geodatabase tables and populate. Can anyone help with this?
Hi Everyone, I have a workspace which contains a reader for a WFS and a writer for Oracle. I have an issue where if the WFS doesn't read any data then it does NOT run any of the transformers or the pre/post sql scripts for the writer. This is a problem because if the data has changed we want out database to reflect that. This means that if there is NO data in the WFS we want our table to have no data in it. I can write python to have it delete the data from Oracle but then I also have to kick off some procedures and run some other SQL and realistically that should be in the post SQL. Additionally this would add a third party dependency on a python module which we don't want. My questions - Is this a bug or is this how it is meant to function? Is there possibly a setting I'm meant to change for WFS to run the workspace even when no features are read?
Hello, I have a very simple workflow which reads ESRI Shape file and converts it to either KML, MIF, MITAB etc. using generic writer. To create a compressed output file I appended .zip to DestDataset. I am facing an unusual behavior in case I try to convert to KML. When I select KML as output format it creates zip file with kml but the file name inside the zip is comping as something _auto_zip_<some numbers>.kml. This is the case only for KML for MITAB, MIF file names are same as source shape file. e.g. If source shape file is test.shp and output format is MITAB then it created zip with test.tab, test.id etc but if the output is KML then it create zip with _auto_zip_1256789651236_1234.kml Could anybody explain is this behavior as expected? Cheers John
I read txt, shp, and csv files zipped a url all the time. For some reason, when I set Column Aligned Text (CAT) as the reader for fixed width files, FME cannot see the file. What's going on here? btw, it's a .dat file inside a zip. Thanks,
Hi Everyone, I've a little question to ask, How do I read a list of files from a text file (Throught text file reader), which is placed in the parent folder of another data reader in the same workspace. I can do it manually, but I want the text file reader to automatically read a certain file from the parent folder. The attributer creater is not willing to expose my created attributes as private/public variable, which i wanted to use as an input to Text file reader. Thanks
Enlarging the “text” that appears in the “FME Data Inspector” from the “workbench”, I couldn’t figure out if there is a way to enlarging the “text” that appears in the “FME Data Inspector” from the “workbench”. For example, the “text” output below appears in small size, how to enlarge its size from the “workbench”? Thank you Best Jamal
Hi Folks, So I've inherited a workspace that has a generic writer in it. One of the formats it writes is File Geodatabase (ArcObject). One thing we've noticed is that FME seems to append to the GeoDatabase rather than overwriting it. As it's a Generic writer, is there a way to specify Overwrite = true? I.e. with an attribute? The doc's don't seem to say what the default is so I'm guessing it's False based on what we're seeing. Using FME 2013. Thanks, Jonathan
Hi everybody, I have a raster image(TIFF file). I want to import it to Postgis. How can I do? I tried it : - Reader: read tiff file , - Writer: PostGIS Raster. But I got error. Could you tell me please how can I do? Thank you
Can the Generic (Any Format) Reader handle an arbitrary schema or is it limited to a fixed schema? This quote from the FME 2014 documentation suggest that it should handle arbitrary schema: "... and is very useful for solving problems when the input format and schemas are not known at design time." However I have a workflow with Generic (Any Format) Readers that throws an error when I change one or more of the input datasets when testing. The error is: "During translation, some features were read that did not match a reader feature type in the workspace. This can happen if the reader is changed, or a reader feature type removed or renamed." "The following unexpected feature types were read:" ..... My workflow checks for a number of data problems. There are two datasets: a reference dataset and a dataset to check. The reference dataset and the one to check are each used by a Schema (Any Format) Reader so I can check schema differences and a Generic (A
Hi, I have an XYZ file with 1 million points at regular 1m horizontal intervals. I want to convert this to contours, however when I tried ContourGenerator and SurfaceModeller transformers, all I got was a square polygon showing the extent of the XYZ points. Does anyone know what I'm doing wrong or if I should be using a different transformer? Thanks,
Hi there, I've created a workspace you can point at any folder containing multiple shape files, and outputs an access mdb files that simply summarizes the counts and present attributes for each shape. The problem is however, FME seems to ignore “Empty” shape files. This is somewhat understandable, but is there any way I can bypass it? The nature of the tasks this workbench has to perform dictates that it also needs to list the empty features. The count will be zero for these specific layers, but I still need them to be added to the output file. I’ve done several tests, and it doesn’t seem like the empty layers get thrown away at any of the specific transformers, so I’m guessing that it’s an inherent feature of FME it self? Or am I missing something? Thanks in advance,
I have a lidar point cloud clipped by building footprints and grouped by the building id. I would like to calculate slope for the points in each building, which I assume would be: (elevation of point_with_maximum_elevation minus elevation of point_with_minimum_elevation) divided by (length between point_with_maximum_elevation and point_with minimum_elevation). I have used the PointCloudStatisticsCalculator to get the min and max, but it does not tell me where these points these are so I can't determine the length between the points. Is there another way to do this? Thanks
Hi! I work with Maritime Spatial Planning and thus have a lot of mapping to be done. One of my biggest concerns is that very often in maps there are layers upon layers - areas of national interest - in the maps, making them hard to read. However, there isn't always a conflict between the interests because some are below the surface, some are on or below the seabed and some are above the surface. My problem is that I wish to make a traditional map and in that map include cross sections as an inset from lines I draw (and then run through FME). I have gotten as far as extruding (seabed bathymetry model)-draped lines with line on area overlay to polygons, but I cannot export the results to shape to use in ArcMap or QGIS. It has to be a popular format because these results will be shared. So: I have a lot of polygon and line interests which intersects my freshly drawn cross section-line (straight line, 2 vertex is good enough). Line on area (and line) overlay. Extrude the fea
Hi All, We have a simple GeoRSS reader workbench here which we would like to publish to our FME Server. The server sits behind a proxy, so proxy authentication is passed into the GeoRSS readers advanced parameters. Doing some testing on FME Desktop, if I set the proxy settings in the GeoRSS advanced properties, but don't have those setting set in the FME Desktop network options, the workbench hangs for a while whilst trying to call the RSS URL and eventually fails like below: As soon as I set the proxy settings in the FME Desktop network options, regardless of whether it's set in the GeoRSS properties, the workbench runs fine. So first question is, what is the point of the GeoRSS Network Proxy parameter? If it doesn't seem to effect anything. Does the GeoRSS reader use a different HTTP Client library to other readers/transformers (i.e. HTTPFetcher)? Also, are we able to set a global proxy setting for our FME Server, in the same way we set the network options in Deskto
Hi We are testing FME 2012 (32x) with MapInfo v12 on WIN7. When I want to extend MapInfo V12 with the FME Integration Console, I can't do it. It says I have to upgrade my licence. Is FME 2012 sp4 compatible with Mapinfo v12? If not, we are also testing FME 2014 soon. Is FME 2014 sp2 compatible with MapInfo v12? Thank you!
Hi, I'm converting tiff (with tfw) file to ecw, but after transformation there is no eww (ecw's world file) neither is ecw properly georeferenced. Yes, there is a way to georeference it by changing the extension of original tfw file, but that doesn't solve problem if you're running any other transformations (e.g. clipper) in between. Thank you in advance.
Hello, I need to read a file from an external Sharepoint server in FME Desktop. When I open the https link in the web browser I first get directed to a login page where I can type the username and password. Is it possible to pass domain\\username and password in the Source file parameter in FME so the Excel file can be opened in FME? Thanks, Daniel
Hi, Most of the docs on DGN tags are unfortunately about writing them. But I need to read them intelligently. Tags are exposed as the list variable tag_names{}, which either contains the tag key names, or the tag values, dependent on the "Output Tags As Text" setting in the DGN reader. And the values in the tag_names{} list is accessed used a numeric index, not the key names. If one needs to build some logic to handle the situation, where individual objects has vastly individual tag assignments, both name wise and index wise, how does one go about that ? Intuitively I would loop thru and test the key names, and assign the corresponding value to a variable of my choice. But as I see it, this is not possible in FME 2014 !? Any experiences and thoughts and suggestions on - or alternatives to - this issue ? Cheers Lars I
I have a design file with used levels and unused levels. When reading this file in FME I can only see the objects, which means I can only see the used layers. But I am interested in the levels that I don't use. Is there any way to get to this information? When programming in Visual Basic for example I can get information about the model and information about the document. How do I do this in FME?
I have two featureclasses in a geodatabase. These two FC are related with each other, 1st with Object ID and 'X' in 2nd featureclass. i want to update a field in 1st featureclass on the basis of 2nd FC, after it is joined.
Hi, is it possible to connect to shape layers on an FTP site with a wild card? for example this WILL WORK: ftp://user:password@the.server.com/download/my_private_dataset.zip But I would like to get this (or the same idea) to work: ftp://user:password@the.server.com/download/*private*.zip so the idea is that the reader would simply read all the layers which match the criteria. Thanks for any suggestions!