Dashboards-maps: documents size limit

stellar-c · February 20, 2024, 1:17pm

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
2.11

Describe the issue:
As described here Update documents size limit by junqiu-lei · Pull Request #141 · opensearch-project/dashboards-maps · GitHub

update default query document size limit to 1000, the max is from index.max_result_window size,

But in fact limitation is set to 10000 and is not aligned with index.max_result_window:

github.com

opensearch-project/dashboards-maps/blob/811e8b096b77c57fb820516262d5c3e3d4f43c3b/public/components/layer_config/documents_config/document_layer_source.tsx#L212


      
                source.geoFieldType = geoField.type as 'geo_point' | 'geo_shape';
              }
              setSelectedLayerConfig({
                ...selectedLayerConfig,
                source,
              });
            }
          }, [indexPattern]);
          
          useEffect(() => {
            setHasInvalidRequestNumber(
              selectedLayerConfig.source.documentRequestNumber < 1 ||
                selectedLayerConfig.source.documentRequestNumber > 10000
            );
          }, [selectedLayerConfig.source.documentRequestNumber]);
          
          const onEnableTooltipsChange = (event: {
            target: { checked: React.SetStateAction<boolean> };
          }) => {
            setEnableTooltips(event.target.checked);
            const source = { ...selectedLayerConfig.source, showTooltips: event.target.checked };

Is there any other way to increase the number of documents ?

Configuration:

Relevant Logs or Screenshots:

stellar-c · February 21, 2024, 10:58am

I have found a dirty way to do it.

Create your map and save it.
Go to [Dashboards Management] > [Saved objects]
Export your map as ndjson format.
Edit the downloaded file and modify documentRequestNumber property according to your index.max_result_window size:

"documentRequestNumber":100000
Save the file.
In [Dashboards Management] > [Saved objects] use the import feature to import the modified ndjson file.

Et voila.

Edit: to update your index setting index.max_result_window size using Dev Tools :

GET /index_or_alias_name/_settings

PUT /index_or_alias_name/_settings
{
  "index.max_result_window": 100000
}

Topic		Replies	Views
Opensearch fetch restriction to 10K records OpenSearch troubleshoot	3	1698	August 1, 2022
Truncate documents when a document exceeds index.mapping.depth.limit OpenSearch troubleshoot , configure , index-management	2	90	April 5, 2024
Losing top documents when query reaches the `terminate_after` limit OpenSearch troubleshoot	3	246	November 3, 2023
Set map position with Document map with coordinates OpenSearch Dashboards dashboard-maps	1	202	July 18, 2023
Mapping size is larger than 10MB - Why is it hardcoded? Reporting Plugin	0	419	September 13, 2022

Dashboards-maps: documents size limit

Related Topics