Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/pelias/terraform-elasticsearch

Terraform scripts for running an Elasticsearch cluster
https://github.com/pelias/terraform-elasticsearch

Merge pull request #25 from pelias/missinglink-patch-1

fix: exclude 'dot indices'

46420d59201b7b16a1538baf887a11b0c3e793e5 authored about 3 years ago by Julian Simioni <[email protected]>
fix: exclude 'dot indices'

"In general, most of the indices that would be considered system indices have
names that start ...

1e1a32877c0552b2ee4f366362c24d90a5304c38 authored about 3 years ago by Peter Johnson <[email protected]>
Merge pull request #24 from pelias/handle-geoip-database

fix: Handle '.geoip_database' index when creating alias

031269d8fe6924b77f7114cf0a2ed58fc78c7165 authored about 3 years ago by Julian Simioni <[email protected]>
fix: Handle '.geoip_database' index when creating alias

Newer versions of Elasticsearch natively include a GeoIP database.

The code to set up the conve...

afca4dc3326a7b5d73b264acbe0eb4729d23af5e authored about 3 years ago by Julian Simioni <[email protected]>
Merge pull request #22 from bboure/add-region-config

Fix ec2 discovery config

367dbc65575f8e9f7eed4be148063a0547a19bcf authored about 4 years ago by Julian Simioni <[email protected]>
Fix ec2 discovery config

5cb663271e490a4a0fde57f1cacdcdec882c38fe authored about 4 years ago by Benoît <[email protected]>
Merge pull request #20 from pelias/start-elasticsearch-on-reboot

Ensure Elasticsearch is restarted on reboot

8601c68e41f1f704061734fc250dfe190af989b0 authored over 4 years ago by Julian Simioni <[email protected]>
Ensure Elasticsearch is restarted on reboot

20804f89d77bc92dc26d1d5091027a6890ceee7d authored over 4 years ago by Julian Simioni <[email protected]>
Update example module usage to latest version

I'm sure at least one person will copy/paste without updating it

e8efcb21e50d0353cd72e327fd9a161f08e9db69 authored over 4 years ago by Julian Simioni <[email protected]>
Document subnet_name_filter_property value

This was introduced in
https://github.com/pelias/terraform-elasticsearch/pull/18

1e8d6109e9c30a48873fe74fb994f31da465301a authored over 4 years ago by Julian Simioni <[email protected]>
Merge pull request #18 from pelias/subnet-filtering-improvements

feat: Allow filtering subnets by any tag

1806c2677072bdeff1708660c9eab673f146721a authored over 4 years ago by Julian Simioni <[email protected]>
feat: Allow filtering subnets by any tag

This change allows filtering the list of subnets within which EC2
instances are launched.

Previ...

1d587ff98fb0c1c50711262c1665b260afc335aa authored over 4 years ago by Julian Simioni <[email protected]>
Merge pull request #17 from pelias/support-any-index-name

fix: support any index name when loading snapshot

92621f959b42218905dd48dd26d82533339bed1a authored over 4 years ago by Julian Simioni <[email protected]>
fix: support any index name when loading snapshot

These scripts have long required that the index name loaded from
Elasticsearch snapshots is call...

5fe793bb2e6a1958ece56f9ed8c246b6e70bf196 authored over 4 years ago by Julian Simioni <[email protected]>
Merge pull request #16 from pelias/elasticsearch7

Elasticsearch7

c9609e74ddc68dd4887b7a8059b97be2dec733ea authored almost 5 years ago by Julian Simioni <[email protected]>
Add ES7 compatibility note to README

c821ccd0df5f8c9af15f2d04e86d3a5d0ebd2f5e authored almost 5 years ago by Julian Simioni <[email protected]>
Skip setting cluster read-only

In ES7, this setting does unexpected things like prohibit replicas from
saving correctly.

While...

8af73940a8c8b17c80d65e219b26a33d974baf4c authored almost 5 years ago by Julian Simioni <[email protected]>
Set `gateway` discovery/cluster-state settings

See https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-gateway.html#modules...

f273579667686cd74ebcdf73ce9570c39808a261 authored almost 5 years ago by Julian Simioni <[email protected]>
Remove deprecated minimum_master_nodes setting

This setting is now ignored in ES7, so we might as well remove it.

See https://www.elastic.co/g...

df3d74b6cf096ea5cc880fac670320a8a280c7af authored almost 5 years ago by Julian Simioni <[email protected]>
Use AWS API to get list of IPs for cluster

This is required in ES7 as the list of potential masters must be hard
coded, and identical, on a...

5e342fb9b9db3ebfc9ac56771498be34d41001e0 authored almost 5 years ago by Julian Simioni <[email protected]>
Delete unused parameter

6883bfeb3e58f73d6643f0c3ac052abd3d5a27e7 authored almost 5 years ago by Julian Simioni <[email protected]>
Use new 'seed_providers' parameter

ebbb82ef6a6300a95b666804295426b46ec69bd0 authored almost 5 years ago by Julian Simioni <[email protected]>
Merge pull request #14 from pelias/fix-heap-size-setting

Set min/max JVM heap size correctly

91ed4c10aeb4558119b08c24d7fcfbee6015bb2c authored about 5 years ago by Julian Simioni <[email protected]>
fix(JVM): Set min/max JVM heap size correctly

These settings have moved to `/etc/elasticsearch/jvm.options`.

See https://www.elastic.co/guide...

ab1bea8c4b487d6b1f2ee7cd617ccfe4839ef5b8 authored about 5 years ago by Julian Simioni <[email protected]>
Merge pull request #11 from pelias/elasticsearch6

elasticsearch 6 support

d9b592a21bf9022fe40ebe64b2a723520f4ab1b8 authored about 5 years ago by Julian Simioni <[email protected]>
Use new setting for enabling EC2 discovery

See https://www.elastic.co/guide/en/elasticsearch/plugins/7.4/discovery-ec2-usage.html#_enabling...

496976652012fb628a6a33ebe4b5bf36688f3508 authored about 5 years ago by Julian Simioni <[email protected]>
Remove deprecated setting `cloud.aws.region`

This is now auto-detected by default.

See https://www.elastic.co/guide/en/elasticsearch/referen...

5aecaa4dacacef5b7d9e47f631fab1cc46f081bf authored about 5 years ago by Julian Simioni <[email protected]>
Move autoscaling group to its own file

13a154387dc354c3fd45360882c6ead19a795bf1 authored about 5 years ago by Julian Simioni <[email protected]>
Move launch configuration to its own file

cd4f3fce850d1606b27e175b70006a9059ebd879 authored about 5 years ago by Julian Simioni <[email protected]>
Update readme with workaround for tag issue

https://github.com/pelias/terraform-elasticsearch/issues/12

a6a13d8d2ff3175bef78f5a7f1d9e041d64c712c authored about 5 years ago by Julian Simioni <[email protected]>
Add a provier section to the readme example

74c349d2b6fedae933b302ae4101a724bb3edd97 authored about 5 years ago by Julian Simioni <[email protected]>
Update README with latest settings

1d504268d5f0a1d22361aace2a885b9145fdabb2 authored about 5 years ago by Julian Simioni <[email protected]>
Merge pull request #7 from pelias/strict_content_type_checking

set json request header to avoid errors…

2ae71959f2e207b8719847dc080423f0a949d433 authored about 5 years ago by Peter Johnson <[email protected]>
Merge pull request #10 from pelias/put_template

set "index_patterns" for PUT _template

bcda3a8c314a1fc4cd4384dfa5ee69e525ce71f4 authored about 5 years ago by Peter Johnson <[email protected]>
fix(es6): set "index_patterns" for PUT _template

b0118b957493889d9b27bcf400ec00ca856faea2 authored about 5 years ago by missinglink <[email protected]>
strict_content_type_checking: set json request header to avoid errors in es6+

834c36079d2e319d304efa40c0e4c9caa998117b authored about 5 years ago by missinglink <[email protected]>
fix(AMI): Allow less strict matching on AMI name

Connects https://github.com/pelias/packer-elasticsearch/commit/bb42c0670190648fe6c57bf704c30bfa4...

feb78b7c6814d7aa6660524c77b50c2359df3d64 authored about 5 years ago by Julian Simioni <[email protected]>
Merge pull request #6 from pelias/az-allocation-awareness

Availability Zone allocation awareness

80c05af2044202ee683a6a401c4f0b32a24074c0 authored over 5 years ago by Julian Simioni <[email protected]>
Add variable to control allocation awareness attrs

1fb83805ee9c2dbf264145008ddc75e70a7e2dbf authored over 5 years ago by Julian Simioni <[email protected]>
Add auto_attributes setting

The `discovery-ec2` plugin can [automatically
set](https://www.elastic.co/guide/en/elasticsearch...

75826d47f0da3c461f2385b879cf37c678c6be55 authored over 5 years ago by Julian Simioni <[email protected]>
Cleanup old comment

59735fa91475134fd8f367f25601eb7a628d86cc authored over 5 years ago by Julian Simioni <[email protected]>
Add note about Terraform 0.12 support

Closes https://github.com/pelias/terraform-elasticsearch/issues/3

9eb9a460bb8ad11bcfbcbc918cd2ed7d652c5ce5 authored over 5 years ago by Julian Simioni <[email protected]>
Merge branch 'ebs-volume-type'

28793b928a68268f5e3e72191893999d127e47fd authored over 5 years ago by Julian Simioni <[email protected]>
feat(EBS): Allow selecting EBS volume type

c0af6eedf1b6124386d9706eec5c94a6998112a0 authored over 5 years ago by Julian Simioni <[email protected]>
Merge pull request #2 from pelias/additional-security-groups

feat: Allow custom additional security groups

06cf9fe21f2596d398c5d7fc7087a45f5f219cde authored over 5 years ago by Julian Simioni <[email protected]>
feat: Allow custom additional security groups

This change allows the Elasticsearch nodes to be associated with extra
custom security groups.

ec8515ebe0af6039da9b9d81030e61afae292264 authored over 5 years ago by Julian Simioni <[email protected]>
Update default variable values for cluster sizing

It's gotten cheaper and easier to run a full planet cluster!

8454c8ee25e821abde10b73a2fec691269e41822 authored over 5 years ago by Julian Simioni <[email protected]>
Merge pull request #1 from pelias/add-configuration-settings

Add new configuration settings

69aa8d8d6697ddb6c4f59355aa2985de39ddd757 authored over 5 years ago by Julian Simioni <[email protected]>
Allow setting delayed allocation timer

https://www.elastic.co/guide/en/elasticsearch/reference/master/delayed-allocation.html

6369c04be7a9ca65bb0419dc98b3f21c445eb9be authored over 5 years ago by Julian Simioni <[email protected]>
Allow configuring search pool size

a9ccfcb428f29c21bc508af75ece83accf25420d authored over 5 years ago by Julian Simioni <[email protected]>
Add README

f276bcc551a6d5ca8bf20c128acb7a2c6d441c66 authored over 5 years ago by Julian Simioni <[email protected]>
feat(elasticsearch): Prefer local NVMe disk if found

This allows Elasticsearch instances with local NVMe disks to use those
very fast, local disks. I...

8c8ffc4362c0c33a37d9b1eb512e94977e682ace authored over 5 years ago by Julian Simioni <[email protected]>
feat(elasticsearch): Autodetect snapshot name

29f6825dae2af6627ffd4909d0ad2a5f7bd2c124 authored over 5 years ago by Julian Simioni <[email protected]>
feat(disk): Reduce reserved disk space

By default, new Linux filesystems are created with 5% of space reserved
for the root user. This ...

cd461e579c85684b9af08d748fd3fdd2ff2134cb authored over 5 years ago by Julian Simioni <[email protected]>
feat(elasticsearch): Support disk watermark settings

These settings configure how much available disk Elasticsearch will
allow itself to use before t...

fbdc8731ef8ee8ef4933f0f935ee10df51f6b6cc authored over 5 years ago by Julian Simioni <[email protected]>
curl: increase verbosity and exit(1) on >=400 status codes

5e476f5665085b5f3215670d141b7f39b82810ae authored almost 6 years ago by missinglink <[email protected]>
Use shared elastic_wait in load_snapshot script

dd67988daaa312552dd74fff87b91cc99c9802bc authored almost 6 years ago by Julian Simioni <[email protected]>
feat(es5_compat): fix exit after elastic_wait

eb32e751551997d488a34c8d0d5f28f760d02331 authored almost 6 years ago by missinglink <[email protected]>
feat(es5_compat): fix exit after elastic_wait

72cc0c2aaba5c739fa2dfc65d4e56821b6c5d53d authored almost 6 years ago by missinglink <[email protected]>
feat(es5_compat): fix typo

66cec4f0ad07e37b5c734407ce0484ec95a41729 authored almost 6 years ago by missinglink <[email protected]>
feat(es5_compat): update packer, fix template interpolation bug

5f39b1041c3598ddf3da6676c7f0a50b7e4b028f authored almost 6 years ago by missinglink <[email protected]>
feat(es5_compat): modify configuration to support both elasticsearch versions 2.4 and 5.6

f8af6f46e8b2d0ac3e1e16117f35a74ed9a373eb authored almost 6 years ago by missinglink <[email protected]>
feat(elasticsearch): Allow S3 bucket name to be optional

3bcad18e78554f2d65a42377d5607d3a19a043a9 authored almost 6 years ago by Julian Simioni <[email protected]>
Support terraform 2.0 templates

5ec7de8dcaebcaa7e13a20041485e43f94e90b8e authored almost 6 years ago by Julian Simioni <[email protected]>
feat(Elasticsearch): allow disabling ELB

Sometimes, an ELB is unwanted when creating an ES cluster. It might be
just for testing, or ther...

dac920bb9e08c6d435e7c4dc542bc801546cab0e authored about 6 years ago by Julian Simioni <[email protected]>
Use latest version of launch_template

6d006e8fd5d5f55f18643f1d849f1ff77ee472ad authored about 6 years ago by Julian Simioni <[email protected]>
Add tags variable and good defaults

d1de4bd24f8653ab8e0a7759e14df387ff1b1257 authored about 6 years ago by Julian Simioni <[email protected]>
Switch from launch_configuration to launch_template

Launch template allows better tag settings, and can be used without an
autoscaling group.

cb6696302e48a8eb3283f815b0015714b0f8b9b3 authored about 6 years ago by Julian Simioni <[email protected]>
elasticsearch: make cluster read only after loading snapshot

This helps prevent against any sort of accidental damage:
https://www.elastic.co/guide/en/elasti...

309d3befd0ee2d2f87d13b0a71cdc3c73185cd9a authored about 6 years ago by Julian Simioni <[email protected]>
Allow setting ES fielddata circuit breaker limit

72dc85fe10beb23e62f61e161e67acceec6f039e authored over 6 years ago by Julian Simioni <[email protected]>
Only run snapshot load on the master node

Technically not required, but it keeps the elasticsearch logs clean

d6ec350b8ec61c99c7a66f478555a570e0873dcf authored over 6 years ago by Julian Simioni <[email protected]>
Set ES node name from hostname

14d6ca838ea91913d3b6145ce6904222d19a1a5b authored over 6 years ago by Julian Simioni <[email protected]>
Support loading elasticsearch snapshot

fbea62071342cfbe6715d15653e7cea2e5dd7412 authored over 6 years ago by Julian Simioni <[email protected]>
Change variable to S3 bucket name rather than ARN

The ARN is easy to calculate

51d84d1d4c434db81ed6183711ca59410a4921ea authored over 6 years ago by Julian Simioni <[email protected]>
Move cloud-init setup to its own files

6faa985b506636e3b14100d7f7a797508120cc39 authored over 6 years ago by Julian Simioni <[email protected]>
Make ES listen on localhost

a910489b88551f0cfe37eb95aef2e04e83688e72 authored over 6 years ago by Julian Simioni <[email protected]>
Don't add public IPs

d64790c8a104def1e98dc5bdc31f898c6c2ec9ba authored over 6 years ago by Julian Simioni <[email protected]>
Simplify block device handling

Thanks to the udev rules now set up in the AMI, its easy to mount the
right block devices no mat...

b453d4ccebc3ac13786ee96e488355ea133f57b8 authored over 6 years ago by Julian Simioni <[email protected]>
Remove some of the more extreme slowlog thresholds for now

d80f959ca13ebf85e4db60581e11fd41681bf7e0 authored over 6 years ago by Julian Simioni <[email protected]>
Bash style fixes

728ff7998f6b9d396dddfeb9ba96daf2a71a5e96 authored over 6 years ago by Julian Simioni <[email protected]>
fixes #33

167ce4265c32bc927de6a5aa440dfac7c10a5254 authored over 6 years ago by Lior Broshi <[email protected]>
Add elasticsearch slowlog settings

Ideally these would be configurable, but for now, set some hopefully
reasonable defaults

86a9322a7409c7cf609df1bf7b1400de4846851e authored over 6 years ago by Julian Simioni <[email protected]>
Properly setup AMI tag filter

It is now possible to filter AMIs used to launch the Elasticsearch
instances by a tag. Previousl...

4f7d5ce7279c9186a8b576d91c4d0dee940ee447 authored over 6 years ago by Julian Simioni <[email protected]>
Allow specifing IP address range for SSH to ES nodes

7ee7def71806a1f4df954615f09966344d045689 authored over 6 years ago by Julian Simioni <[email protected]>
Decouple ES ASG from Launch Configuration

This makes it easier to do rolling updates of the cluster

c8552c99cf62da373e419c57b8e6b733a9bbbdae authored over 6 years ago by Julian Simioni <[email protected]>
Allow setting availability zones for ES cluster

It was previously hardcoded

58c414af793bed7f8ff6fee8b4a4e23edae59ded authored over 6 years ago by Julian Simioni <[email protected]>
Add tag filter on Elasticsearch AMIs

this allows for creating new AMIs and ensuring they are not immediately
used in production.

376e51fa11f9c5d4977621cea29508bc7954992a authored almost 7 years ago by Julian Simioni <[email protected]>
Switch Elasticsearch ELB to HTTP mode

This allows for better metrics in CloudWatch and hopefully is neutral or
positive for performance

c68c9f0954131ff55bde2ffe2dc6b857385c3a25 authored almost 7 years ago by Julian Simioni <[email protected]>
Support t2 instances for elasticsearch

This requires conditionally disabling EBS optimized instances

f6e3f66594f1ca537a85abfa661cf2bc9aa1170a authored almost 7 years ago by Julian Simioni <[email protected]>
Terraform fmt

8cee9d4b5e3ff940ca11e29f0806736dd8383f5c authored almost 7 years ago by Julian Simioni <[email protected]>
Allow configuring ES JVM Heap percentage

5c9a91572dae1b52cc69a22be547df454b1aaddc authored almost 7 years ago by Julian Simioni <[email protected]>
Set up IAM role for read permissions to S3 snapshot bucket

7021216ff1ccbefd30584d808040411bae6c3a36 authored almost 7 years ago by Julian Simioni <[email protected]>
All the zones

78cf9c74eff43fd3ba1e9739b11e43bd417a52ea authored almost 7 years ago by Julian Simioni <[email protected]>
Allow selecting subnets within the VPC based on a variable

242077e62ba25c472966446b96ccc89b779e4599 authored almost 7 years ago by Julian Simioni <[email protected]>
Update VPC filter name

This should be a variable soon

016683fb69c809afb5fbcd19e25e1314ef234057 authored almost 7 years ago by Julian Simioni <[email protected]>
Add team tag to ES cluster

53d1dfe7b889ced1f47d32a992772c2c5ad01641 authored about 7 years ago by Julian Simioni <[email protected]>
Add comment to outbound traffic rule

14d3cda287d1323a74896921d73e478d762e29ba authored about 7 years ago by Julian Simioni <[email protected]>
Set minimum master and expected node counts

Without these, it is very likely that with, for example, a 4 EC2
instance autoscaling group of E...

c7ce7e224ab4886bb279be933a180f460b263a0d authored about 7 years ago by Julian Simioni <[email protected]>
Fix discovery EC2 groups setting

See https://www.elastic.co/guide/en/elasticsearch/plugins/2.4/cloud-aws-discovery.html
for the s...

68d58872e35e0696a04b640b7492b9ed2e7471d2 authored about 7 years ago by Julian Simioni <[email protected]>
Shorten ELB name

There is a fairly short total limit

a3796562c4788b17ae729a0dad32cdd0a46aff23 authored about 7 years ago by Julian Simioni <[email protected]>