amazon-web-serviceselasticsearchaws-elasticsearch

AWS ElasticSearch Service and DataStream


Does AWS ElasticSearch service (OpenDistro) not support DataStreams? I was trying to create a data stream today with AWS ElasticSearch service but was unable to do anything. Trying to get the list of data streams just returns

{
    "Message": "Your request: '/_data_stream' is not allowed."
}

As per X-Pack docs here it states that all elasticsearch versions after 6.3 would have X-Pack by default, and I'm using elasticsearch version 7.10 on AWS ElasticSearch service.

I couldn't find anything in the docs that explicitly states whether this is supported or not. Would be a great help if someone can give more information about this.


Solution

  • It does not support, AWS Elasticsearch Service and Elasticsearch have a few differences.

    Data streams is a feature only available in the Elasticsearch distributed by Elastic itself, licensed under the Elastic License.

    AWS used a fork of the open source version of Elasticsearch, all the features with the label x-pack are only available under the Elastic license, some of them are free, some of them are paid, but they were not available in the OSS versions, which AWS used.

    From version 7.11 Elastic changed the license and now is available under two licenses, Elastic and SSPL, none of them allows AWS to sell Elasticsearch as a service starting from version 7.11.

    This led AWS to fork the last version, 7.10.2 in a new project called Opensearch and the AWS Elasticsearch Service will be rebranded as AWS Opensearch Service.