# My transform job is taking forever
**URL:** https://forum.opensearch.org/t/my-transform-job-is-taking-forever/17231
**Category:** Index Management
**Tags:** troubleshoot, index-management
**Created:** [December 25, 2023, 6:35am UTC](https://forum.opensearch.org/t/my-transform-job-is-taking-forever/17231 "2023-12-25T06:35:21Z")
**Posts on this page:** 2
**Page:** 1
### Author:  [@ammar](https://forum.opensearch.org/u/ammar)
#### Post date: [December 25, 2023, 6:35am UTC](https://forum.opensearch.org/t/my-transform-job-is-taking-forever/17231/1 "2023-12-25T06:35:21Z")
**Versions** (relevant - OpenSearch/Dashboard/Server OS/Browser):
OS:
NAME=“Oracle Linux Server”
VERSION=“8.8”
“version”: {
“distribution”: “opensearch”,
“number”: “2.9.0”,
“lucene\_version”: “9.7.0”,
“minimum\_wire\_compatibility\_version”: “7.10.0”,
“minimum\_index\_compatibility\_version”: “7.0.0”
}
**Describe the issue** :
I have defined a transform job to run every 10 minutes. However, the initial execution is taking forever. Could you please support to diagnose and speed up my job.
What I am intending to do is to calculate the number of transactions per second. My index is about 15GB of data. I am filtering on a term then aggregate and calculate the doc count per second.
**Configuration** :
Transform job definition:
{
“\_id”: “aida\_tps”,
“\_version”: 4,
“\_seq\_no”: 166173,
“\_primary\_term”: 1,
“transform”: {
“transform\_id”: “aida\_tps”,
“schema\_version”: 18,
“schedule”: {
“interval”: {
“start\_time”: 1703484768,
“period”: 10,
“unit”: “Minutes”
}
},
“metadata\_id”: “iENEPT8gWitGerPfeuwHpA”,
“updated\_at”: 1703484768879,
“enabled”: true,
“enabled\_at”: 1703481783298,
“description”: “AIDA TPS index”,
“source\_index”: “ptm\_counters”,
“data\_selection\_query”: {
“bool”: {
“filter”: [
{
“term”: {
“Stream”: {
“value”: “AIDA”,
“boost”: 1
}
}
}
],
“adjust\_pure\_negative”: true,
“boost”: 1
}
},
“target\_index”: “aida\_tps”,
“page\_size”: 1000,
“groups”: [
{
“date\_histogram”: {
“fixed\_interval”: “1s”,
“source\_field”: “Date”,
“target\_field”: “Date”,
“timezone”: “Asia/Kabul”,
“format”: null
}
}
],
“aggregations”: {},
“continuous”: true
}
}
**Relevant Logs or Screenshots** :
Transform job explain logs:
{
“aida\_tps”: {
“metadata\_id”: “iENEPT8gWitGerPfeuwHpA”,
“transform\_metadata”: {
“transform\_id”: “aida\_tps”,
“after\_key”: {
“Date”: 1702900165000
},
“last\_updated\_at”: 1703486004106,
“status”: “started”,
“failure\_reason”: null,
“stats”: {
“pages\_processed”: 3623,
“documents\_processed”: 145,
“documents\_indexed”: 64,
“index\_time\_in\_millis”: 1395,
“search\_time\_in\_millis”: 3277420
},
“continuous\_stats”: {
“documents\_behind”: {
“ptm\_counters”: 146212395
}
}
}
}
}
---
### Author:  [@system](https://forum.opensearch.org/u/system)
#### Post date: [February 23, 2024, 6:36am UTC](https://forum.opensearch.org/t/my-transform-job-is-taking-forever/17231/2 "2024-02-23T06:36:11Z")
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.