Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/sous-chefs/kafka

Development repository for the kafka cookbook
https://github.com/sous-chefs/kafka

Set defaults in a separate (private) recipe

Since one can define broker configuration options in a number of
different ways we cannot really...

7318c4eff4bd796cf0a8a412e4074029e6aaffa0 authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove unnecessary `log_dirs` attribute

36b11643a41d7537085280c5e89c061f5c466c6c authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove unnecessary comment from default attributes

77416f8f1045b40979fd874946a9291b5c09ef19 authored over 10 years ago by Mathias Söderberg <[email protected]>
Rewrite `recipes` intro. in README

[ci skip]

112600a53915413d4c8a7ff25a0f74c474956804 authored over 10 years ago by Mathias Söderberg <[email protected]>
Fix incorrect attribute syntax in README

[ci skip]

4e51aca2ecfa7078544de7a317504cd7d31bf2e6 authored over 10 years ago by Mathias Söderberg <[email protected]>
Version bump to v0.5.0

Quite a “large” release with a ton of changes, ranging from a rewrite of
how “configuration attr...

684a7afa1dec4f51bc265a4095cfbd188b55160c authored over 10 years ago by Mathias Söderberg <[email protected]>
Account for different ways of defining `log.dirs`

The (obvious) downside of having too many ways of defining configuration
attributes. Perhaps I’l...

3bb9e4b86c7225b53b92a9341df74dddf56f8da4 authored over 10 years ago by Mathias Söderberg <[email protected]>
Merge branch 'pfleidi-fix-opsworks-file-cache-permissions'

938c4e00c50e10f80abf0a40c13c0b29b83d13cf authored over 10 years ago by Mathias Söderberg <[email protected]>
Fix kafka installation on Opsworks

Chef's file cache path is apparently only readable by `root` on
OpsWorks, so we have to extract ...

1bf4111f5019bb3fed37292b636a7163f88c0653 authored over 10 years ago by Sven Pfleiderer <[email protected]>
Add header to `libraries/log4j`

3884b26b45335725c849d10cc5347f8524522d26 authored over 10 years ago by Mathias Söderberg <[email protected]>
Rename files in `libraries`

The modules are already namespaced, no need to namespace the individual
files as well.

b4c21c9b71bbf2b0c811f15011ba3a8702fa78e6 authored over 10 years ago by Mathias Söderberg <[email protected]>
Update README w.r.t. new broker configuration attrs.

Just a heads up for the peoples. Could be expanded to explain some
corner cases and whatnot.

[c...

f8af85dec7467e0908d4a47378f75fdabebe2455 authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove `log_level` attribute

Rather define levels individually for loggers. Don’t forget those
trailing commas, yo!

5c89bdb32311a737082143d9a23adbea41f13735 authored over 10 years ago by Mathias Söderberg <[email protected]>
Use `jmx_port` directly from attribute

Previously ZooKeeper and Kafka had different JMX ports, but used the
same template for rendering...

cb4d26fa4a366980ef169e631365183bc20ad443 authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove `config` attribute

Was only needed for setting up ZooKeeper with a different configuration
file from what Kafka was...

653b292581d5fa01f9ba783c910bb7708b8bbf44 authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove `log4j_config` attribute

Was only needed for setting up ZooKeeper with a different configuration
file from what Kafka was...

e49d1270ffb83bb56af64e6b5fcc13927d7e68e4 authored over 10 years ago by Mathias Söderberg <[email protected]>
Use `dotted` notation rather than `hash` notation

Because I like it better, mkay?

c7345988576c5e9397ed271687abf3a2677b22ea authored over 10 years ago by Mathias Söderberg <[email protected]>
Merge branch 'dynamic-configuration-attributes'

b881e5319664517d40226391df33b5c4190d142c authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove unused config. related partials

Not used since the configuration rendering is done using helper methods
rather than partials.

e438d5b34bbb0967b855dac9550ee69789e2b9bb authored over 10 years ago by Mathias Söderberg <[email protected]>
Update headers in template files

Just a heads up.

c034bc638d18bc9483fedefffe157d70561c89b2 authored over 10 years ago by Mathias Söderberg <[email protected]>
Convert _ALL_ configuration attributes to a flat namespace

Oh this is just the beginning. FULL SPEED AHEAD!

1d0f4074a0e314df6b6be004e332938cea60e5bf authored over 10 years ago by Mathias Söderberg <[email protected]>
Leave “mixed” configuration names as-is

If there’s a configuration parameter that contains both underscore and
dots we don’t want to con...

25f1b1454165736475dcbf655b638d653741da24 authored over 10 years ago by Mathias Söderberg <[email protected]>
Allow nested Hash notation for broker configuration

So, decided to re-introduce the nested Hash notation for accessing
configuration attributes, as ...

5d653efd6dd584d5887b7734ca5522ed475fd058 authored over 10 years ago by Mathias Söderberg <[email protected]>
Generate property keys from `broker` attributes

Instead of defining _ALL_ possible configuration attributes in
`attributes/default.rb` we’ll gen...

f07a91d50586a98472ba224f2b2b2d2f0deb2f68 authored over 10 years ago by Mathias Söderberg <[email protected]>
Put all configuration attributes under a `broker` namespace

Next stop, dynamically generate configuration properties.

476810ee05dcbec0e061e469a9fb53e1c1e53b06 authored over 10 years ago by Mathias Söderberg <[email protected]>
Allow `dotted` notation for broker configuration

This commit makes it possible to use either underscored symbol keys for
configuration attributes...

ebd6b7905c2ab8b3274f75c0b03b5ca6276e9849 authored over 10 years ago by Mathias Söderberg <[email protected]>
Update `kitchen-docker` to v1.5.0

626cd3f2b9a58534becaf5f5b9e80e16610bc72c authored over 10 years ago by Mathias Söderberg <[email protected]>
Merge branch 'configurable-gc-log-settings'

0d4c5f3218922416a818476b18c441a960c6ac16 authored over 10 years ago by Mathias Söderberg <[email protected]>
Consistent usage of `’’` vs `””` in attributes

a17dc30c343570046268e732e0d547b61b69be7a authored over 10 years ago by Mathias Söderberg <[email protected]>
Make KAFKA_GC_LOG_OPTS configurable

When I did a trial run with setting up Kafka using this cookbook I
noticed that it logged *A LOT...

1e82700c0b6a628ba30151e150d96fb3a3741a91 authored over 10 years ago by Mathias Söderberg <[email protected]>
Merge branch 'sane-log4j-configuration'

174d409902787c807cf4b38ff2179553375d3df1 authored over 10 years ago by Mathias Söderberg <[email protected]>
Make it easier to override logging config.

The previous structure did make it a bit cumbersome to override for
example the appender type, w...

746846ee6f4ef033824c20572195a066c02117bf authored over 10 years ago by Mathias Söderberg <[email protected]>
Roll over log files on a daily basis

Rather than an hourly as from what I’ve seen during a quite small
experiment is that Kafka doesn...

17cbcd5b5a27f6715fc49c9021571771a343101a authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove `LogCleaner` logger

The appender doesn’t even exist in the bundle configuration file, and it
is easy enough to just ...

992e0cf21f12be8e3894d8309fc898ccb84862f9 authored over 10 years ago by Mathias Söderberg <[email protected]>
Switch TRACE level with INFO

I wouldn’t deploy anything with TRACE / DEBUG as log level to production
as it will *most likely...

7f9354a2d88cc75ec92b0d3c0f34575badef38c0 authored over 10 years ago by Mathias Söderberg <[email protected]>
Update tests for log4j configuration

Whoops, probably should’ve done this way back.

73079a8366357d30a44924ff770a6f709ee6a7b8 authored over 10 years ago by Mathias Söderberg <[email protected]>
Configurable log4j configuration

When I deployed a Kafka cluster the other week I realised that some of
the “default” options in ...

463cec9072e69144f2663f132ea77f89e0c172ce authored over 10 years ago by Mathias Söderberg <[email protected]>
Update log4j `rootLogger`

`stdout` doesn’t really make sense since both stdout and stderr are
redirected to `/dev/null` in...

924056326119bdfcfcc2afb2d853f6afc6e8d1cf authored over 10 years ago by Mathias Söderberg <[email protected]>
Exclude Ruby 2.0 & 2.1 for Chef 11.10.4

502f5ae16497f4e6dd2e04bd10869b7c7648e4b8 authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove `ruby-head` from .travis.yml

68bd1e02f5f5e531f0cb81ecaa2b565cbbfd874d authored over 10 years ago by Mathias Söderberg <[email protected]>
Merge branch 'remove-zookeeper-recipe'

abcbd12dc9880f587493d1987dee63e57e4e15a3 authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove String interpolation in `default` recipe

e9d00c66762df05b8f6836b24e9998fc74dc7fda authored over 10 years ago by Mathias Söderberg <[email protected]>
Simplify `kafka_init_opts` helper method

Don’t need it to be “configurable” anymore.

86216339a567bf9d14f62331e7e8164948a485ea authored over 10 years ago by Mathias Söderberg <[email protected]>
Rename `kafka.env.erb` template

10d44c48cad6603a51c27705f963998dbc961b2a authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove setup of ZooKeeper

Setting up ZooKeeper is well beyond the scope of this cookbook, as it’s
only intention is to set...

cb695370ecbea2fa228b4c6109e01ad99732c207 authored over 10 years ago by Mathias Söderberg <[email protected]>
Use new ChefSpec.start! method for coverage reporting

23e7e1e1da82600edd6ef3ceccfa187468af069c authored over 10 years ago by Mathias Söderberg <[email protected]>
Version bump to v0.4.1

I’d consider this a patch release due to the fact that this should’ve
been done since the start,...

8ee48014bd92d2449e7d264b59398a730c3715f7 authored over 10 years ago by Mathias Söderberg <[email protected]>
Merge branch 'create-log-dirs'

20cb9652db1ff980ec293d99cd9054a343ce862d authored over 10 years ago by Mathias Söderberg <[email protected]>
Add integration tests for creating `log.dirs`

4c61af9a3833b831492a8a204428a28a755632f8 authored over 10 years ago by Mathias Söderberg <[email protected]>
Create `log.dirs` directories in `_setup` recipe

Not really sure how I missed this before, because this feels like
something that should really b...

f61753c350adce79f3a6cbd17615827c858990ce authored over 10 years ago by Mathias Söderberg <[email protected]>
Add missing comment for `log.dirs` attribute

[ci skip]

3b035b1c6f6704010f3fa15fcf4bd9ebde4b926a authored over 10 years ago by Mathias Söderberg <[email protected]>
Version bump to v0.4.0

49e91d5b5033de15d8dc51e60b664b51344631a1 authored over 10 years ago by Mathias Söderberg <[email protected]>
Reorder automatic_{start,restart} test & update test description

444994a734e839ebd6f3ee646339b076ff940f80 authored over 10 years ago by Mathias Söderberg <[email protected]>
Update development dependencies

cb9169ffcd2867ce6d20f0221854efcc29b46067 authored over 10 years ago by Mathias Söderberg <[email protected]>
Merge branch 'automatic-start-restart'

Closes #42.

397b8f89df74cdf1fdf809ef82e2d0b5c315bb71 authored over 10 years ago by Mathias Söderberg <[email protected]>
`automatic_restart` implies `automatic_start`

Reasoning stated in the comment.

eb5803bbbe6c2a6ca005271b9c5313c5e0600225 authored over 10 years ago by Mathias Söderberg <[email protected]>
Start kafka automatically if `automatic_restart` is set

Now, I’m not a fan of starting / restarting things automatically as it
tends to break things, bu...

d8a18f12f56f4b8f10456a1ee9e69e9199edee16 authored over 10 years ago by Mathias Söderberg <[email protected]>
Additional configuration to consider for automatic restart

* /opt/kafka/log4j.properties
* /etc/init.d/kafka
* /etc/sysconfig/kafka

And the corresponding ...

561809f0f0076f9e6e187a079b94b404ea8b463b authored over 10 years ago by Mathias Söderberg <[email protected]>
Restart kafka on server configuration file change

One could argue that it should restart if env configuration file changes
as well, and probably l...

b768e244502588a19b07dfc446353224dca82acf authored over 10 years ago by Mathias Söderberg <[email protected]>
Add `automatic_start` attribute

When set to true, `:start` will be added to the `action` array that is
given to the kafka servic...

981e0963bb0ac000e0602db180ad4cce5298c956 authored over 10 years ago by Mathias Söderberg <[email protected]>
Ignore packaged releases

Did some cleanup of `.gitignore` in general as well.

ba1b6cfeb9be905148562430eb47e43056cd25be authored over 10 years ago by Mathias Söderberg <[email protected]>
Version bump to v0.3.0

d677d5b04dfcba6ec2c63d9eab332a7a457e3830 authored over 10 years ago by Mathias Söderberg <[email protected]>
Fix broken integration test of “installed” file(s)

Of course `Array#grep` returns a list, not true/false, duh.

f60929e3db273539d42728197bb6de1ed1e84397 authored over 10 years ago by Mathias Söderberg <[email protected]>
Merge branch 'jakedavis-suggest-java'

575d483cac9e96dd5e3fb7e172ef166afadb8b19 authored over 10 years ago by Mathias Söderberg <[email protected]>
Add `java` as “test” dependency in Berksfile

4ed7d9062bb596e711e6721f8224119b0ece7373 authored over 10 years ago by Mathias Söderberg <[email protected]>
Switch java recommendation to suggests

This gets around a rather insane set of circumstances wherein Berkshelf
won't let you ignore rec...

78b6c95f006a1e37fbb204f5edb513109fe186bc authored over 10 years ago by Jake Davis <[email protected]>
Fix deprecated RSpec matcher in `helpers/install_common`

ccdfb475069234ab6486494731048426f5d95b69 authored over 10 years ago by Mathias Söderberg <[email protected]>
Ignore `pkg` when packaging a release

10959589d9e09d7024121df2d77bfcabbab7d7b8 authored over 10 years ago by Mathias Söderberg <[email protected]>
Version bump to v0.2.1

Changes:
* Bugfix for missing `status` option on `service` definitions (#39).

Cheers to @bijugs...

fd8fc8d203d6a3ad69a775136522f6301c4ec99e authored over 10 years ago by Mathias Söderberg <[email protected]>
Merge branch 'bijugs-service-status'

3232461e4dbbab015c8ff9d15df527b00672da7c authored over 10 years ago by Mathias Söderberg <[email protected]>
Added supports status: true so that service start will not fall back on checking the process table for kafka. The latter will show as kafka running since zookeeper process runs as kafka user.

a2dd08fbe57a0ba7fa61f57a48a12e44385a9ee5 authored over 10 years ago by bijugs <[email protected]>
Lock RSpec to v2.14.1 in gemfiles

6b89063702525de6c7b23805c3d1a45017cf7e38 authored over 10 years ago by Mathias Söderberg <[email protected]>
Include Chef v11.10.4 in Travis

24af4dfc9efa8b42248f52b7763412e6a9d62749 authored over 10 years ago by Mathias Söderberg <[email protected]>
Lock ChefSpec to v3.4.0 in gemfiles

This should work, hopefully?

532db56770b29ba1e936977c30de8798b023ae77 authored over 10 years ago by Mathias Söderberg <[email protected]>
Update ChefSpec to v4.0.0

742caeaeac26c361ab798d79e1d52758b04e54fe authored over 10 years ago by Mathias Söderberg <[email protected]>
Lock rspec versions in `gemfiles/Gemfile*`

Travis keeps installing 2.99 which apparently doesn’t work.

5c3d08cb61be875c144e9641efd7b2e699eee395 authored over 10 years ago by Mathias Söderberg <[email protected]>
Update Chef versions & Ruby versions for Travis

Run the last patch release for each previous version of Chef 11, and
only run for the Ruby versi...

e032a73cc926fa957d2c3fbf29b3e5f8475d1288 authored over 10 years ago by Mathias Söderberg <[email protected]>
Add simple Rake task for testing 0.8.x w/ docker

e36f9dcb44119a105ba57fe3c7eedcfb28075c12 authored over 10 years ago by Mathias Söderberg <[email protected]>
Use empty strings in .kitchen configuration files

72749630ba8e1ea57930ac9be77b52186af4bf95 authored over 10 years ago by Mathias Söderberg <[email protected]>
Make it possible to override Kafka version in `.kitchen.yml`

918de75df9cd90f6b1dfbf4cad732e9c0bfe485b authored over 10 years ago by Mathias Söderberg <[email protected]>
Add Gemfile for Chef v11.10.4

As the development dependency now has been updated
to the latest version.

86b8e37c4656849a01002c5f182854698fe7c51b authored over 10 years ago by Mathias Söderberg <[email protected]>
Update development dependencies

099cca0dc42a6a8ae9dbd8af82602efac77c1002 authored over 10 years ago by Mathias Söderberg <[email protected]>
Update README w.r.t. to new OS versions

[ci skip]

a80d9203ba4a807528428790df54f68a2fa89d1f authored over 10 years ago by Mathias Söderberg <[email protected]>
Merge branch 'kitchen-docker-support'

c8057b1d72842b4f6fd4b167a1d72a862810cdc0 authored over 10 years ago by Mathias Söderberg <[email protected]>
Add minimalistic `.kitchen.docker.yml`

Running things in docker is a lot faster than spinning up vagrant boxes
(even though docker runs...

0706429fd6289256842a9623dc8ba6a9530551a0 authored over 10 years ago by Mathias Söderberg <[email protected]>
Add `kitchen-docker` gem

3325602ec9fac30a4318e6e238fefdbc0cec4841 authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove ubuntu-12.04 from `.kitchen.yml`

c377d686f20f476395b621e9dbf96ec38b06cfea authored over 10 years ago by Mathias Söderberg <[email protected]>
Move ‘common’ files in `helpers` to a ‘support’ directory

fe5e9fd5043f08947536b5451e0fe0d6b27c193b authored over 10 years ago by Mathias Söderberg <[email protected]>
Update to ubuntu-14.04 in `.kitchen.yml`

af7f388c1a9e47223dd2bb5517ba661cc45173ce authored over 10 years ago by Mathias Söderberg <[email protected]>
Update to debian-7.4 in `.kitchen.yml`

08359badf1248c9e011434cffe465bc237461018 authored over 10 years ago by Mathias Söderberg <[email protected]>
Actually specify ‘upstart’ as init style in `.kitchen.yml`

9f60e780418187b431c9179b3fdc7c32f8b519a9 authored over 10 years ago by Mathias Söderberg <[email protected]>
Update to fedora-20 in `.kitchen.yml`

1058b47f526d28f9d2d62751330302af7d6797bf authored over 10 years ago by Mathias Söderberg <[email protected]>
Ignore `pkg` directory

f2b6cef05c2f5829e65803a79e017b43e759d5e8 authored over 10 years ago by Mathias Söderberg <[email protected]>
Version bump to v0.2.0

Changes:
* Bugfix for `log.dirs` attribute (#36).
* Updated log4j template (#32).
* Expose JVM p...

72409a0858d9c08ef60b953891066efdd53cff09 authored over 10 years ago by Mathias Söderberg <[email protected]>
Tidy up Rakefile

* Removed part of a commented line.
* Clarified “error” message.

04aa5f4a1133086f02242c6d46410a7a99a01bce authored over 10 years ago by Mathias Söderberg <[email protected]>
Update Rake task to ignore `gemfiles` directory

fc02b49f0b7c6f561165cc06afa4cb1d13d482c1 authored over 10 years ago by Mathias Söderberg <[email protected]>
Add init-style suites for installation from source

There’s really no point in having a `source` suite on it’s own. Much
better to test that Kafka a...

ad3982a30c59a185c24eee9257d92cb25244c47f authored over 10 years ago by Mathias Söderberg <[email protected]>
Remove “binary” suite from integration tests

Indirectly it was always tested through the `init-style` suites, so we
might as well check that ...

107e9873d7330a7e4c01680966db9b9721f3360d authored over 10 years ago by Mathias Söderberg <[email protected]>
Update integration tests and helpers for Fedora

* Serverspec changed so that ‘fedora’ is now its own ‘family’.
* For some very unknown reason, t...

45d9346c0523f09e8b6e7bd1eef0eb0a19faee09 authored over 10 years ago by Mathias Söderberg <[email protected]>
Add explicit unit test for multiple log directories

45b4f5ff832c9abfd5f4259fe8989f4e3b02f9cd authored over 10 years ago by Mathias Söderberg <[email protected]>