#Timeplus com code#
The new UDF framework will enable our users to accomplish more by combining the powerful streaming analytics capabilities with custom code or 3rd party libraries and APIs. Make sure the UDF name doesn’t conflict with the built-in functions or other UDFs in the same workspace. Only the Timeplus workspace administrators can register new User-Defined Functions, while all members in the workspace can use the UDFs.ħ. Properly adding logs to your UDF code can greatly help troubleshoot/tune the function code.Ħ.
Please make sure the returned value matches the inputs.ĥ. That’s why in the sample code, I will process the ip as an array and also return the value in the other array. For example, if there are 1000 requests to the UDF in a single SQL execution, the framework may send 10 requests with 100 each for the input. To improve performance, Timeplus automatically sends batched requests to the UDF endpoints. User-Defined Aggregate Functions (UDAF) will be introduced shortly with a better foundation for you to build customized aggregate functions, or stateful processing. In some systems, this is called User-Defined Scalar-Valued Functions. The current UDF system in Timeplus is not designed for aggregation. SELECT ip_lookup(ip):city, count(*) as cnt FROM access_log GROUP BY cityģ. SELECT ip_lookup(ip):city as city, sum(cnt) FROM (SELECT ip, count(*) as cnt FROM access_log GROUP BY ip) GROUP BY city It’s recommended to aggregate the data first, then call the UDF with a lesser number of requests.e.g. Calling a single UDF may only take 100ms or less, however, if you call a UDF for millions of rows, this could slow down the entire query.If not, return an error code to deny the UDF request. In your endpoint code, be sure to check whether the key/value pairs in the HTTP header matches the setting in Timeplus. Timeplus will set this in the HTTP header while making requests to the remote UDF endpoints. For example, when you register the function, you can set the key as ‘passcode’ and the value as a random word. For Timeplus Cloud customers, it’s highly recommended to enable Authentication for the UDF.There are some additional factors to consider when building and using User-Defined Functions:
#Timeplus com full#
User-defined functions open the door for new possibilities to process and analyze the data with full programming capabilities within Timeplus. For our large customers with strong on-prem deployment needs, we also built a “Local UDF” mode which allows Timeplus to call local programs to process data. “Remote UDF” is the recommended solution for our Timeplus customers to extend the capabilities of built-in functionality, without introducing potential security risks for our cloud services. You can also build the remote UDF with your own microservices or long-running application services to gain better control of the hardware resources, or gain even better performance or low latency.
#Timeplus com free#
For more complex data processing, feel free to include more sophisticated libraries, such as machine learning.Īccording to the CloudWatch Logs for the Lambda function invocation, the average response time for the UDF is about 100 milliseconds.
In this example, we are using the built-in node.js “https” library.
0 kommentar(er)
