Using readers and writers to extract and load data.
Recently active
log.txtMy writer into an esri fgdb is failing.An error occurred while attempting to store a row into the table 'PriOHElectricLineSegment'. The error number from ArcObjects is: '-2147221230'. The error message from ArcObjects is: {} The error message of "{}" is not very helpful. I attempted to look it up with esri without any luck.Does anyone know the source of the problem?Thanks
I have an Excel spreadsheet where I want to pass several attributes as variables into a SQL Query using a SQL Creator transformer. What is the best way to achieve this? I don't see how I can make the attributes as user parameters.
I am getting "Python Exception <KeyError>: u'token'A fatal error has occurred. Check the logfile above for detailsFailed to obtain any schemas from reader 'ARCGISPORTALFEATURES' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationUniversalReader -- readSchema resulted in 0 schema features being returnedReader Parameter(0) = >https://gisgateway.williams.com/portal<Reader Parameter(1) = >RETRIEVE_ALL_FS_NAMES<Reader Parameter(2) = >Yes<Reader Parameter(3) = >AUTH_TYPE<Reader Parameter(4) = >generate_token<Reader Parameter(5) = >USER<Reader Parameter(6) = >ckeating2<Reader Parameter(7) = >PASSWORD<Reader Parameter(8) = >********<Reader Parameter(9) = >_MERGE_SCHEMAS<Reader Parameter(10) = >YES<Reader Directive(0) = >RUNTIME_MACROS<Reader Directive(1) = >RETRIEVE_ALL_FS_NAMES,
Hi all,We have FME server on linux using docker; FME Server 2017.1.1 - Build 17650 - linux-x64.Unfortunately we found out that some processes are generating core dumps and hss_err_pidxxxx.log files.Does somebody know, what could be root of the issue or where should we start to find out the root of the issue? Also how to identify what process exactly is causing generation for core dump and hs_err_pidxxx.log creation?thanks a lot in advance!information from hs_err_pid153.log file:# # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x00007f6469201630, pid=153, tid=0x00007f644203c700 # # JRE version: OpenJDK Runtime Environment (8.0_131-b11) (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11) # Java VM: OpenJDK 64-Bit Server VM (25.131-b11 mixed mode linux-amd64 compressed oops) # Problematic frame: # C [libfmeutil_jni.so+0x12630] JNIEnvGetterManager::GetCurrentThreadJNIEnv()+0xe0 # # Core dump written. Default location: /data/fmeserverdata/reposit
I need to use the elasticsearch writer with authentication - works great in Beta but I need to get it into production with both desktop and server.It would be great if I could some timescales so that I can feed back to the project team
I have created a workspace based on https://community.safe.com/s/article/creating-pdf-cartographic-outputthat outputs a simple PDF. Users can input a specific attribute (via a published parameter) and query out this feature, buffer around it and the output map is centered around this feature. Background data such as hydrology, roads and text are clipped to a bounding box from the buffer and displayed to give context to the location of the queried feature. This works very well when there is only one feature as it produces a simple map zoomed to a suitable scale showing the queried feature and the surrounding background data. I would like to modify this workspace to run multiple queried features through it and produce multiple PDFs showing one queried feature per page along with its background data. I'm not sure how to achieve this. Should I be looking to use a data fanout? Or would a loop work? Any help I can get would be most appreciated.
My goal is to be able to have an AGOL feature service that overwrites the previous version each time the workspace runs on FME Server. As of now, I can't get the AGOL writer to work at all. The error I am getting is 'ArcGIS Online Feature Service Writer: Could not find a layer/table matching feature type '"featurename"'. Any tips regarding using this writer?
When writing las files fme defaults to determining its own scale factor and offset values to utilise in the output file. For a las to las conversion is there a way of forcing fme to maintain/use the same offset and scale factor values that the input las file has?
Hi, ACAD reader has \\ as an illegal character, breaking hyperlinks.AutoCAD Reader: Renamed attribute 'G:\\Stuff\\Morestuff' to 'G__Stuff_MoreStuff' to remove the following invalid characters '<>/\\&$|:!~ ()"@'Is there a known workaround in the meantime? Thank You
Hi,I'm trying to automate a process where FME reads in an Excel sheet in a specific format, but i need to split the Sheet into two parts (as they are completely different structures) and treat as two different datasets effectively. Is there a way in the Excel sheet reader to effectively duplicate a sheet in order to choose the different cell ranges that i require?
I'm working with FMEServer.I developed a small workbench that connects to s3, reads the content of some folder and downloads it into FME resource folder. The problem with downloading occurs only while first running. I get the following error:FAILUREjava.lang.Exception: COM.safe.fmewebservices.FMEWebServiceException: COM.safe.fmeserver.api.FMEServerException: QSInvalidRequestWhen I repeat a job, right after that, the job is done successfully.In both cases, engines are turned on.My workflow is as follows:Any idea of solving this problem?
Is anyone successfully using FME 2018 with Oracle 18? I can't find information on whether or not Oracle 18 is supported.
I am running some simple jobs that merely move datasets from one location/format to another to provide access from multiple systems and applications. When one of the source datasets contains a field name that is a SQL reserved work (SQL Server in this case) FME Workbench is unable to create the output feature class and the job fails. For example I have a Shapefile of airports that has a text field in it named "Name". When I attempt to write this dataset to an enterprise geodatabase without changing that field name the job fails with this error -"An error occurred while attempting to create the feature class 'airports_metro'. The error number from ArcObjects is: '-2147215961'. The error message from ArcObjects is: {Invalid database name [08004:[Microsoft][SQL Server Native Client 11.0][SQL Server]Database 'NVARCHAR' does not exist. Make sure that the name is entered correctly.] [EGH_PUBLIC_WGS.ARCMAP_ADMIN.airports_metro]}" Is there a way t
Hi all, I've city buildings in .gml formats.And also i have aerial images of city.I would like to texturizing buildings from aerial images.So, i want to use texture coordinates of images.How can i describe and correspond texture coordinates and my buildings?
I have a workspace in FME server, that includes PythonCaller.The PythonCaller includes a script that needs a directory as one of its input parameters.The directory that i want it to use, is provided to the PythonCaller as hidden user parameter. The definition of the user parameter is just text, and the value also consists of other user parameter values, that were provided from a desktop workspace which triggers the server workspace.I have tried everything. I've changed the parameter definition and i've to put r and quote marks around the value. Still the workspace fails.This error message for example comes, if i just try to input the user parameter value as just plain directory (D:\\Data\\citydb_temp\\...)" Python Exception <OSError>: [WinError 123] The filename, directory name, or volume label syntax is incorrect: 'D:<backslash>Data<backslash>citydb_temp< ..." So how do i put a user parameter directory as an input parameter in to the PythonCa
What I'm trying to do, is to convert a JSON response form a HTTP caller to a standard table format (Excel or CSV). The issue is how do I tell FME that I want the specific keys as column headers?
Hello,I need to process a number of text files holding differing numbers of data rows.The first 7 lines are fixed - they are the loggerid / siteid / channelref / units / totals / startdate / enddate.After that there could be a different number of rows with a datetime and a value.I need to process these files into a sql table with the fixed 7 lines data added to the datetime and value rows. The data in the first 7 lines will change so I need FME to process the files once at a time into the writer rather than all at once.Any idea how I do this?CheersN
I am using a creator and a GoogleDriveConnector to upload pdf files in a folder structure in a drive. After the upload is completed, I am trying to read the path names of each file using a Directory and File Pathnames Reader. I also use a featureMerger to join the features from the Pathname Reader with another Feature Type.My question is: can the Pathname Reader access the sharable link of every files it reads so that during the merged features have the link as an attribute? Thank you
I have been reading the 2018 Desktop Basic documentation. When introducing the Integration Transformers there is an example of workbench shown below :From the situation, I suppose the Dropbox contains only images with specific names. These names have to be contained in the ImageFile attribute of Parks. I am wondering about the set up of the connector which allows the join of the right feature with the right ParkImage. I believe a Download action from the connector might have been done and that the destination probably was set to Attribute, but I don't seem to make it work on my own.
When I translate from shapefile to DGN, inside Microstation the Element information for "Line Style Parameters" always comes across as 1.0000. Is there a way to set this during translation to a different value? Thanks. Bonus Question(s)Is there a way to set the Fill for any "Shapes" that come across to 'NO FILL' or 'None'.Is there a way to have point features which are translated to CELL come across as an annotation cell?These also need the is Annotation value set to False.
R4414A2.lazhello every oneMy name is Maher I am student at University of Oulu FinlandNow I am Working on modeling 3D City Model using FME .I have a GML file that have the information of buildings and everything .However I want to store the Building information from the gml file to a text file . And the data should be like<height> <number of corner> <coordinates of vertice1> <coordinate of vertice2>.........................<coordinate of verticeN>for each building I should have a line of information like this .Could someone help me to achieve this structure
I have a bunch of workbenches running and one feature class in particular is acting very peculiar.This data is simply being moved from one GDB to another, it is new data overwriting old data.Today (for example) it is just five features, the first feature in the list will not overwrite, but the rest do.I imported the first feature on it's own and it worked, I also tested it where I selected the tables in a different order, and that worked.I then deleted the reader and created a new one, and the feature ran and was successful on the feature class. The second time I tested it, it didn't work.This same thing happened on a different workbench with the same feature list, that first one did not work.Any ideas why it won't work sometimes? The only thing that I see is it is the first in the list of the feature list I'm running and it is the only name that shows in the "Feature Class or Table Name" in the transformer (see second image below), even though it's runnin
Hi,I would like to create a pointcloud (las file) from a csv. The csv has x, y, z and some other attributes. On one x,y coordinate I have different attributes per z value. How can I create a point cloud without loosing the attributes? I manage to create an pointcloud via an aggregator and geometrycoercer, but then I lost all the attributes. Any help is appreciated.Arno
While updating my sde geodatabase the writer in FME is really slow. Does anyone have expierence with speeding this up? The articles I find on performance are not enough to solve my problem.It updates as much as 1 object per second. And I need to update 30.000 records.It seems that the old version of the writer is working fine. However, now that I am using FME 2018.1, the writer is much slower. Edit: i must use edit sessions, because of a versioned database I hope that someone can help me!Kind regardsJelle
I have multiple features incoming so I need to make this a non-manual process. Currently I'm overwriting a number of features (but not all) in a gdb with updated data that is incoming. Some of the features are completely new data, so they need to import into the same GDB. I currently have my writer set to Truncate Existing, which works perfectly for overwriting. Any ideas how I can Overwrite and set it to import a new feature (if there is one) as well?Thanks