Forum Widgets
Latest Discussions
KQL Query output limit of 5 lakh rows
Hi , i have a kusto table which has more than 5 lakh rows and i want to pull that into power bi. When i run the kql query it gives error due to the 5 lakh row limit but when i use set notruncation before the query then i do not get this row limit error on power bi desktop but get this error in power bi service after applying incremental refresh on that table. My question is that will set notruncation always work and i will not face any error further for millions of rows and is this the only limit or there are other limits on ADE due to which i may face error due to huge volume of data or i should export the data from kusto table to azure blob storage and pull the data from blob storage to power bi. Which will be the best way to do it?
Azure ADX - UpdatePolicy fails to insert data
Hi Everyone, I believe everyone is doing good and safe. I am facing challenge with ADX. Please find the problem details below. Problem statement: We are unable to insert a result data into a target table from source table using an UpdatePolicy. Description: We have written an UpdatePolicy on a table. This UpdatePolicy will accept query parameters as an ADX function. This function returns output result in the form of table. Further, This table output result received should be inserted into target table. Additional Details: UpdatePolicy helps to update the data into a target table from source table dynamically/automatically. UpdatePolicy is almost equivalent to Triggers in SQL Server to do dynamic insert into a target table. Syntax of UpdatePolicy .alter table TargetTable policy update ``` [ { "IsEnabled": true, "Source": "SourceTable", "Query": "SourceTable | extend Result = G3MS_ClearAlarm(Id, CountryCode, OccuredTime) | project AlarmId = Result.AlarmId, ClearAlarmId = Result.ClearAlarmId, ClearTime = Result.ClearTime", "IsTransactional": true, "PropagateIngestionProperties": false } ] ``` Error Received when executed Error during execution of a policy operation: Request is invalid and cannot be processed: Semantic error: SEM0085: Tabular expression is not expected in the current context. If anyone has any suggestions/thoughts on this will be very beneficial to complete the requirement.
Union and then distinct values of a column
Hi, Here is a description of my problem. I have 3 tables, but i will take the example of 2. in each table, I have a column "common_col". I want to combine the values of this 2 tables to get one column and then return the distinct values : like that i will be sure that i have the values of each tables. ********************Script 1********************** ((table1 | project common_col | distinct common_col) | union (table2 | project common_col | distinct common_col)) | distinct common_col ******************************************************* ******************Script 2 ******************************** ((table1 | project common_col | distinct common_col) | union (mv_pdb_process_stl | project common_col | distinct common_col)) | summarize by common_col ********************************************************** The first and second script, because when after importing the data in Power BI, I tried this : Nb_distinct_values = DISTINCTCOUNT('Newtable'[common_col]) Nb_Total_rows = COUNTROWS('common_col') I don't get the same number and it is don't normal. So there is an issue in my script and I need help please ! Thanks !ADX data receiving stop after sometime
I have very strange problem. I have IOT application where device send data to IOT hub, then it routed to event hub. There is function with trigger as azure function ,this function insert data in to ADX . I trace the event from device to event hub. I can see all data I can also see function get trigger ,no error.But in ADX empty record, no data from event. Just date field which add explicitly. Note- Again after some time I can see data in ADX (no change in ADX not even restart any service). Can any body have clue what exactly could be issue?
External Table in ADX
Hi, I'm trying to create an external table in ADX which uses a Synapse Analytics (SA) database view (called undelivered). The undelivered view itself is query data from a Cosmos analytical store I've create a user defined idenity Added the identiy to the ADX cluster, SA and Cosmos Updated the ADX database: .alter-merge cluster policy managed_identity[ { "ObjectId": "a3d7ddcd-d625-4715-be6f-c099c56e1567", "AllowedUsages": "ExternalTable" } ] Created the database users in SA -- Create a database user for the ADX Managed Identity CREATE USER [adx-synapse-identity] FROM EXTERNAL PROVIDER; -- Grant read permissions ALTER ROLE db_datareader ADD MEMBER [adx-synapse-identity]; GRANT SELECT ON OBJECT::undelivered TO [adx-synapse-identity]; From within SA I can "SELECT * FROM undelivered" and the correct information is returned But when I come to create the external table in ADX: .create-or-alter external table MyExternalTable ( Status: string ) kind=sql table=undelivered ( h@'Server=tcp:synapse-xxxxx.sql.azuresynapse.net,1433;Database="Registration";ManagedIdentityClientId=<key>;Authentication=Active Directory Managed Identity;' ) with ( managed_identity = "<key>" ) I get the error: Managed Identity 'system' is not allowed by the managed_identity policy for usage: ExternalTable So even with me specifying the managed identity I want to use it is still trying to use the system one. How can I get the external table created with the correct managed identity? Any questions please just ask ThanksIssue with mysql_request Plugin on Dashboard
Today, while using the Azure Data Explorer dashboard, we noticed that the mysql_request plugin is no longer functioning as expected. Specifically, we are encountering the following error message: evaluate mysql_request(): the following error(s) occurred while evaluating the output schema: The 'mysql_request' plugin cannot be used as the request property request_readonly_hardline is set. Interestingly, the plugin works perfectly fine within the Query tab. However, when called from the dashboard, it fails to execute. This issue was not present yesterday, as it was working seamlessly at that time. Looking further, I realize that in Query Tab, the ADX UI send with "Options":{ "request_readonly_hardline": false } And the request from Dashboard such as Table, Chart. It send with request_readonly_hardline: true Is this on purpose? Thanks
Extending by a function output
datatable(ids: dynamic) [ dynamic(["value1", "value2"]) ] | function(ids) This above snippet works fine and returns a table datatable(date: datetime, ids: dynamic) [ datetime(2022-01-01), dynamic(["value1", "value2"]), datetime(2022-01-02), dynamic(["value3", "value4"]) ] | extend outputs = function(ids) This one however complains that extend expects a scalar and not table that the function returns datatable(date: datetime, ids: dynamic) [ datetime(2022-01-01), dynamic(["value1", "value2"]), datetime(2022-01-02), dynamic(["value3", "value4"]) ] | extend outputs = toscalar(function(ids)) When using toscalar, ids cannot be referenced. Is there a workaround? The function take in dynamic and returns a tubular expression of one row and two columns
SQL Server emulation layer; support for prepared statements
ADX supports very basic transformation of T-SQL to KQL, as it is limited to normal SQL statements. Currently support for prepared statements doesn't seem to be in-place. This would greatly improve security of the emulation layer by enabling prepared statements to be used. This would also allow semantic layers and customer facing analytics tools such as Vizzly to integrate in a secured manner.Disappearing files after ending session
Good day Any idea why my files on a Surface Hub 2s keep disappearing whenever I end session and log back in? Is there a way I can permanently keep them in my Documents folder or at the File Explorer folder and access them at anytime even after ending session? attached I uploaded two pictures. One with the created folder called JEOC Docs and in the other picture the files disappeared after ending session or login out. Like in the below picture.
