Transform job is skipping docs for indexes with refresh interval > 1s

OpenSearch
1

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser): 3.4

Describe the issue:

I created Continious Job run each minute on index with refresh interval = 30s. I noticed some docs are missed even if I filter by some timestamp with delay 60 seconds:

"range": {
              "@timestamp": {
                "gte": "now-3h",
                "lte": "now-60s"
              }
            }

I took deeeper look and noticed, elastic search warn about pottential problems with late arriving docs and have solution for that by specifing sync time field and delay

  "sync": {
    "time": {
      "field": "@timestamp",
      "delay": "60s"
    }
  },

Unfortunatelly it is not supported in opensearch and I don’t see any workaround. We can’t put refresh interval 1 sec to avoid performance issues and general recommendation is to have >= 30 seconds

Also I noticed opened bug with similar issue - [BUG] Transform Job to continuously rollup data prior data is not working · Issue #1400 · opensearch-project/index-management · GitHub

Please assist on that

Configuration:

Relevant Logs or Screenshots: