github.com/unigraph-dev/dgraph commits | Ecosyste.ms: OpenCollective

Modify testrun.sh for running inside docker

6371ea2c4ecacdaa12cdc5b57054abdb8ee3614b authored almost 9 years ago by Manish R Jain <[email protected]>

Add copyright notice to all files in conn module

b779005eef3736c49d948ac61fb249c13a269c1e authored almost 9 years ago by Manish R Jain <[email protected]>

Assign copyright to DGraph Labs, Inc.

6c9b4a74d87b23f05635088c58ab6d900763dd4f authored almost 9 years ago by Manish R Jain <[email protected]>

Decrease all headings by 1 step

4ece8405418a73073b823f97488f026aef7484e6 authored almost 9 years ago by Manish R Jain <[email protected]>

Section on Queries and Mutations

fa196f0cc8a09965367a69b5636eb455bde34dc3 authored almost 9 years ago by Manish R Jain <[email protected]>

Almost done updating the README

b9ba5a9fb9df2a4e16f7a1171e78c3d5d03d439f authored almost 9 years ago by Manish R Jain <[email protected]>

Update README for v0.2 launch

8d47af3294c75224198bfdb59cf31e39e01ec55c authored almost 9 years ago by Manish R Jain <[email protected]>

Quick trial via docker. Section on Mutations.

dc7325057e378ccd77f0403a5a50a46b64b51843 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge pull request #60 from dgraph-io/dmuts

Performance improvements and bug fixes

d69b6847681e7f2e7f79b55228ce1d1ab90936eb authored almost 9 years ago by Manish R Jain <[email protected]>

Use io.ReadFull to allow for Read() returning before reading the full buffer

e52c71a25cd42a18e6ff83ba1f1b4886311860cc authored almost 9 years ago by Manish R Jain <[email protected]>

Don't send uids dir to intances other than zero

1c59268451950e5c0cae09d2c4c546f55789847c authored almost 9 years ago by Manish R Jain <[email protected]>

Move the fp mod out of parseStream, as it's shared between loader and uid assigner.

645535ffbfa4e7ce921ac9c011476c342a57ae39 authored almost 9 years ago by Manish R Jain <[email protected]>

Handle language when forming NQuad. Move the fp mod earlier in the process, to avoid paying for ToEdge() function call.

bb8c40801c88be45cc472be3b3a8dd501917c7da authored almost 9 years ago by Manish R Jain <[email protected]>

Change ratio of dirty PL processing to 7%, now that we can handle it easily via async writes.

60abe29e648c86927ff75de51764f3323d25d032 authored almost 9 years ago by Manish R Jain <[email protected]>

Aync writes to RocksDB are 1000x faster than sync writes. We don't need to do synchronous writes because we do sync writes on commit logs

66aa027eb2cb8c10c706c19fa79a6a655ba6f803 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge pull request #56 from dgraph-io/dmuts

Fix a bug due to which we were unable to retrieve xids.

22299861bf519804a134a78755d4468f1cb92ad6 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge pull request #57 from dgraph-io/rocksGo

Batch write while merging

d82da6bf5694fa5fff33b534f94e9eb02cf7ee56 authored almost 9 years ago by Ashwin Ramesh <[email protected]>

batch write while merging

8eac2743860f97282789e320ecc5008c3dacc43f authored almost 9 years ago by Ashwin <[email protected]>

Fix a bug due to which we were unable to retrieve xids.

c54bf33a5aca5ac41a807f697f3e45c0c4abc30d authored almost 9 years ago by Manish R Jain <[email protected]>

Merge pull request #55 from dgraph-io/dmuts

Tool to debug posting lists in RocksDB

62b6b8fd62a043c12a45d4d0e32dd1a95dd4c1fa authored almost 9 years ago by Manish R Jain <[email protected]>

Tool to debug posting lists in RocksDB

c6c8c452e782885331cb0b74cc18067dfad6a634 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge pull request #45 from dgraph-io/rocksGo

RocksDB merge in go

e7343568a7d05859267c0f544fecdebbd36b2c94 authored almost 9 years ago by Ashwin Ramesh <[email protected]>

removed redundant initialization

4269f674ea082c53a7756f8e80d0d218e24f7819 authored almost 9 years ago by Ashwin <[email protected]>

Start working on the debug tool

9c19a2352f2fc71416420aa2927594372045804e authored almost 9 years ago by Manish R Jain <[email protected]>

make MergeFolder local

de6eb419591edaebbf569520a6a03e5bfde8bdfb authored almost 9 years ago by Ashwin <[email protected]>

change in logic for xid equality

b2d77d9fb89cdf06657fdbf05649c834437c0114 authored almost 9 years ago by Ashwin <[email protected]>

change in logic for xid equality

ba584b68b29ba52483a19d89c122a1c144227524 authored almost 9 years ago by Ashwin <[email protected]>

Merge pull request #52 from dgraph-io/dmuts

Change log output

9982c02e9c3231943a655c443ce4dca1f173e1f4 authored almost 9 years ago by Manish R Jain <[email protected]>

Rename variables, check equivalence of XIDs

ffcb50d3cf6fb1a172ea94fbdea2090e7d496bb8 authored almost 9 years ago by Ashwin <[email protected]>

Use a simple shell script to bring up multiple instances of DGraph

a8a45ee68d1f0fd7dbf6a4331765b57477a88fa6 authored almost 9 years ago by Manish R Jain <[email protected]>

RocksDB merge test and shifted merge code to a function

36cf856bf6c82ff4e57905c498c735d73acbfbef authored almost 9 years ago by Ashwin <[email protected]>

Small fixes and log level changes

85ac49351b4b2c6603ae0a7bb3161ef4e9ba589b authored almost 9 years ago by Manish R Jain <[email protected]>

Merge pull request #48 from dgraph-io/dmuts

Testing Distributed Loader

938e05fe8a9e525c78ea3045c40b6c2100850b53 authored almost 9 years ago by Manish R Jain <[email protected]>

Changes to take into account that values are posting lists

2bc103dc3c7de30efc4a035015f4047174d8e033 authored almost 9 years ago by Ashwin <[email protected]>

Set the number of goroutines for gentle merging to 18. It is little slower to run these goroutines, but they keep the memory usage in check.

37d6146bdee0047a2806c621f193e8d1e76dd505 authored almost 9 years ago by Manish R Jain <[email protected]>

It's faster to let the aggressiveMerge run, than to run gentle merge.

ed9e6d28b11a71dfde1219d343fdc7eca0d06624 authored almost 9 years ago by Manish R Jain <[email protected]>

Keep the number of goroutines running gentlyMerge function in check.

15f13e5b8012e81d5c2d821fc61f5945f547e350 authored almost 9 years ago by Manish R Jain <[email protected]>

Store any errors encountered while running the pipeline. If any error is found, stop processing immediately. Switch the system to sync.WaitGroup completely, instead of an error channel. Log fatal on error in loader and uidassigner

93e35d179ed3c66921e17733e955df0be9e1f52a authored almost 9 years ago by Manish R Jain <[email protected]>

Loader shouldn't cause uid assignment. Add a Get() function in uid, and avoid calling rdf.GetUid. Plus, other changes across the entire code base to accommodate this.

4e6355ffb80667112b4651e0d490ace76f99d423 authored almost 9 years ago by Manish R Jain <[email protected]>

Decrease memory allocations or buffer growth.

9982d13cca7d1a7e2a0fe13897f8e6f26fba6d77 authored almost 9 years ago by Manish R Jain <[email protected]>

removed index field in heap

d15c1f5613686ed4a3004de7e0884a7942156bb3 authored almost 9 years ago by Ashwin <[email protected]>

Change how many keys we merge. Also, run gentlyMerge in a goroutine, so our memory monitor can call aggressivelyEvict in time. Also, with this change, the memory growth is a heck of a lot more controlled.

2678fd40e1cdc718b3a672dc73f8e1765c107585 authored almost 9 years ago by Manish R Jain <[email protected]>

Optimizations based on uidassigner. Also, pick elements from dirtymap randomly.

fa631d8414c16df2dd5b43c02987c217bee2d67e authored almost 9 years ago by Manish R Jain <[email protected]>

Merge branch 'master' into dmuts

9b9aa684ae7d05ef4ae888a4cef849ac9ea542f1 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge branch 'dmuts' of github.com:dgraph-io/dgraph into dmuts

033acc99029100914d21b90195a399ca7d5fe6ba authored almost 9 years ago by Manish R Jain <[email protected]>

RocksDB merging in golang

dfae5ca1b6bb4f90f7917dd2c9a6430387ff5d9c authored almost 9 years ago by Ashwin <[email protected]>

RocksDB merging in golang

3be07857fca071c3bec714fb6c0afc3b7bf72760 authored almost 9 years ago by Ashwin <[email protected]>

RocksDB merging in golang

307f6dd48f323848fbf362c4711c9560accd5517 authored almost 9 years ago by Ashwin <[email protected]>

RocksDB merging in golang

d3b0dc3653beaa0c3ef7385e46593de15f932f98 authored almost 9 years ago by Ashwin <[email protected]>

Pick the number of dirty posting lists to merge, based on the size of the dirtymap.

197f6d23f2bdd281e6bc8c4b24dd7a9409b10281 authored almost 9 years ago by Manish R Jain <[email protected]>

Change flag names, and switch from Error log to debug log

f8a11bda8bb2c6fa740a45075cbac03d730f559e authored almost 9 years ago by Manish R Jain <[email protected]>

Fix build breakage in tests

04d32e47e54c8ea8649d144936370a7a7c45a1a1 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge pull request #44 from tim-cheng/master

use new Lexer initializer

d5f2d9b18429912b44de443f6970d5f2f0f997d6 authored almost 9 years ago by Manish R Jain <[email protected]>

Rename flag in uidassigner binary

2cae836fbf6157025ceb70538e57f02dacddcb8a authored almost 9 years ago by Manish R Jain <[email protected]>

use new Lexer initializer

367e3e97759a8610520b6f1b5789ba99709a56ec authored almost 9 years ago by Tim Cheng <[email protected]>

Merge pull request #43 from dgraph-io/dmuts

Distributed query and mutation testing

15741245d2527e8b70d842c1df47dd8fdb917e45 authored almost 9 years ago by Manish R Jain <[email protected]>

Apparently lock manager isn't being cleaned up. Add a TODO.

2b7bc95a41eb9dc8dae49dba2b71f6243fd15bfb authored almost 9 years ago by Manish R Jain <[email protected]>

Create a sync.Pool for entry struct. This removes newOrExisting in uid/assigner.go from memory profiler.

69a187c5adfd86b2d13cc05c28e905a30fe8d99a authored almost 9 years ago by Manish R Jain <[email protected]>

Allocate lexer on stack instead of heap. This now makes rdf.Parse very cheap, it no longer shows up in top10.

1e1a1cc9b65d369e77c7c96c48d26f54e147728f authored almost 9 years ago by Manish R Jain <[email protected]>

Add memory profiling. Use a sync.Pool for lexer. Add benchmark numbers before and after using sync.Pool. Simplify assignUids only.

68ea2d1581a2e533ba000e6fe9c4b88fce6c2ad5 authored almost 9 years ago by Manish R Jain <[email protected]>

Fixes after testing uid assignment and query execution over multiple workers

ca1c4431563daa070d27ff262b57e6705c3045f1 authored almost 9 years ago by Manish R Jain <[email protected]>

Handle absense of mutation or query in GraphQL. Fix bugs in goroutine's variable access, and pointer assignment to mutationArray.

749b981db01510fee083980dfa04b00f1c396c18 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge pull request #42 from dgraph-io/dmuts

Distributed Mutations: Xid to Uid, NQuads to Edges, Apply Edges

520e856000e84db1ed4efc284f1a546e828cc0b9 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge branch 'dmuts' into dmuts2

7e29acca5f9b9bc81436239bc107a88403af0551 authored almost 9 years ago by Manish R Jain <[email protected]>

Assign uids for xids over the network. Convert NQuads to Edges using the assigned uids, and then apply these as mutations over the network.

32aba405a2e9434239f21b0f0b84185cd154e410 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge pull request #41 from dgraph-io/dmuts

Distributed mutations from DirectedEdges

ab9568213b6429f08ddd2bebf2024281cfd7308c authored almost 9 years ago by Manish R Jain <[email protected]>

Merge branch 'dmuts' into dmuts2

0f7e05aed1fc728cd1add3ab793e83a1ea89d0c2 authored almost 9 years ago by Manish R Jain <[email protected]>

Address code review, plus fix a compilation failure.

b6b8bbc92dac382467983a275c05b35c491081fd authored almost 9 years ago by Manish R Jain <[email protected]>

Expose GetOrAssign as a network call

7fff2de4eaa55add86481d3759d9e9f6880fa4d7 authored almost 9 years ago by Manish R Jain <[email protected]>

Add logic for set mutations from DirectedEdges.

da0e9e19b4aad9113bdbf7dd328807f394e25ae6 authored almost 9 years ago by Manish R Jain <[email protected]>

Fix compilation failure

6d5b0b0171d6b917a2f680e0e35120a694c358f8 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge with master

2a9b517b51440af10e634a8d411c0eb349f0032c authored almost 9 years ago by Manish R Jain <[email protected]>

Forgot to add mutation encoding, decoding code.

2bdabeb4287b2a0e39f23eafb5c50c45b0f18f59 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge pull request #40 from dgraph-io/distributedServer

Distributed server

2fde66eed8d5e521718542872e01208119b4a741 authored almost 9 years ago by Manish R Jain <[email protected]>

Export Addr in conn.pool

a7ddfa5693464e8800d211db971416845c648782 authored almost 9 years ago by Ashwin <[email protected]>

Export Addr in conn.pool

b88f7e422937ab1a5f223c356a96c866bb5995b7 authored almost 9 years ago by Ashwin <[email protected]>

Code refactoring changes in worker.go

98e139a593b52c2cabb8bd16cc13213f9cb9de5e authored almost 9 years ago by Ashwin <[email protected]>

Code refactoring, function signature changes in worker.go

357a6599c5ece15506fa4d8f6749a2be30bcada6 authored almost 9 years ago by Ashwin <[email protected]>

handled uidStore querying which is on instance 0

b9dc381ba92999050f57790668b00166f7f376a7 authored almost 9 years ago by Ashwin <[email protected]>

Add a Mutate RPC call in the worker. This would be used to propagate mutations across the cluster.

8a0a2a9aee9286c05e1beab855d62e5f1ce6272f authored almost 9 years ago by Manish R Jain <[email protected]>

Use ProcessTaskOverNetwork in query.go

88d5cb6c66b05bc180f05b1e31f9547b1c1cbe23 authored almost 9 years ago by Ashwin <[email protected]>

Distributed query over network

b53a59695ae77d338ae474091db90659d870d447 authored almost 9 years ago by Ashwin <[email protected]>

Resolved merge conflicts

383f1c55aee9b7bf2f3779adfa39f0cdc6c37a78 authored almost 9 years ago by Ashwin <[email protected]>

Merge with master

799450d681255e8acb8ff3c54c8d7a5f55f6537c authored almost 9 years ago by Manish R Jain <[email protected]>

Add a mutation handler function in server/main.go

160e1bfdf12dbe987048bdba572955ae31c69538 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge pull request #38 from dgraph-io/distributed

Added a seperate store for xid & uid in server

0deabbb53d773bdfc6365d182f2d9592ed719c0b authored almost 9 years ago by Manish R Jain <[email protected]>

Moved worker flag to server, removed numInstance flag

911d8b32595da06d07f6d6f460babfbd182c6df5 authored almost 9 years ago by Ashwin <[email protected]>

Renaming of stores and formatting changes

b19e15044e785c58868e645a93369753e928ebcc authored almost 9 years ago by Ashwin <[email protected]>

Merge branch 'master' into distributed

0a5f667974fead0a94f916b215e83555da632785 authored almost 9 years ago by Ashwin <[email protected]>

Merge pull request #39 from dgraph-io/dmuts

Encapsulate Call within the client pool library, so we don't have to …

a477eed5a1d380f46ad8be50eb22ba275828a162 authored almost 9 years ago by Manish R Jain <[email protected]>

Remove the local pool slice.

9c8b2205472011cbe5c768e262384c06ffe8ae67 authored almost 9 years ago by Manish R Jain <[email protected]>

Retry on connection refused

ab5c9bddaa1d3860837cce2e6dc8b3714a296bd3 authored almost 9 years ago by Manish R Jain <[email protected]>

Merge branch 'master' into dmuts

845d46e7dea785363049ca0331283852d558913d authored almost 9 years ago by Manish R Jain <[email protected]>

Fix the error and fatal formatting violations.

617e1321ec98ac2c6171220d95dec49a8a7e073c authored almost 9 years ago by Manish R Jain <[email protected]>

added support for distributed query through network calls

8bc03c2c12593a8f4f4c44e4d3dc106d8b537237 authored almost 9 years ago by Ashwin <[email protected]>

Encapsulate Call within the client pool library, so we don't have to expose the clients. Also, write tests for conn module.

c27093d7f9e2cdb7b2f634f47b92cd4ee152b412 authored almost 9 years ago by Manish R Jain <[email protected]>

Query doesnt need a store to be passed

3e917ef00a05bcfa6c9af3608c460c72e7b678fc authored almost 9 years ago by Ashwin <[email protected]>

Added a seperate store for xid & uid in server

3e024bc97e01b77c7ace6ea29dceabbb09cefde7 authored almost 9 years ago by Ashwin <[email protected]>

Merge pull request #37 from dgraph-io/dmuts

Set up communication framework between workers

2a5f0529c10ee0af6e5a83b091128667afeb02b4 authored almost 9 years ago by Manish R Jain <[email protected]>

Custom encoders for communication between workers via net/rpc over TCP. Also, hello there!

0b312744773ab7c32dcf9195b43c5eb990c9ca7c authored almost 9 years ago by Manish R Jain <[email protected]>