Packages by soldair
track-sequence-ids
if you are doing work related to sequence ids this tracks what you should store in your .sequence file.
s3-time-stream
cli tool. stream an exact time range from logs stored in s3. find the time segment with binary search so you download the minimum data possible.
todo-queue
queue work todo in redis and handle it in the same process. keep work safe from process restarts/crashes
kazoo
streaming json parser with the interface of clarinet but streaming chunked value support. (the interface is extremely unstable right now)
chash
hash a value to a consistent number within a specified range. in goes key out goes number that's it.
floody
combines floods of small stream writes while not delaying or buffering writes when not flooded. buffers only up to configure ammount and only keeps buffer around for at most configured interval.
tailreceiver
recieves data as newline delimited json {file:,line:,time} over tcp and commits it to log files.
printastic-protocol
a simple json wire protocol that supports binary file transfers. For talking with printastic servers.
forwardho
forward log data from a bunch of watched log files over the network with a simple json protocol
logtime-interval
when you would like a timer callback to fire based on the timestamp of the data you are processing - the timestamp of the data when you created the timer
npmish
a proxy npm repository server that serves local tars and packs local repos when they are requested.
packagenpmjson
this creates a npm compatable json document. you can use it as a component for private npm registries that doont use couch.
when-connected
call an async method with configurable timeout and when connected if reconnect is used
sentiment-multitool
cli to scan piped text streams or start a web service for sentimint analysis. uses 'sentiment' by diy
colormatch
A module for extracting colors from images and for generating lookup ranges that accept rgb and outputs ranges of rgb values for db lookups. Right now it uses ImageMagik in a child process to reduce the colorspace and return the top colors of an image. Al
packagegitconfig
find the git folder for your package and parse the .git/config file into a useful data structure. also adds the github web url for the repo.
packagereadme
return the readme as a string for the current package based on closest package.json in the specified or parent directory
uniquecache
cache that you found some unique value and make sure you don't tell anyone else in this process that it is unique while you save it.
level-partition-check
return a sublevel that will error if you attrempt write outside of a specified range of keys.
line-stream
split/binary-split but lines contain byte offset in the source stream and gives access to last line fragment
forkfriend
dead simple worker child process manager. respawn children. load balance work amongst children.
jsontoxml
This is a library designed to render js objects as xml. Its not made to parse or otherwise edit existing xml/html structures.
s3npm
publish packages to your own s3 bucket, install an resolve nested private or public deps without replacing or hacking npm
sorted-key-buckets
Map a key to a bucket where the keys assigned to each bucket must be sorted. Creates new buckets as needed. used to make sorted string tables.
memcached-multiplex
combine concurrent gets for the same keys into one get/multiget to the memcache server
memcache-server-stream
duplex stream implementation of memcache server protocol. pipe any net connection to add mc support to your node server
binarysearch
pure js binary search for sorted javascript arrays||array like objects. returns any || last || first || closest matched key for value, or slice between 2 values where values need not exist.
procfs-stats
get detailed information (more than ps, top etc) about running process on linux machines from node.
subtract-stream
subtract the values of the last object from the values of the current object and stream the diffs. also numbers
rotator
Emit rotate events and rotate files based on interval. Rotate event handlers are called "rotater-tots" or just tots. Tots get passed a readable stream the log file path and the data passed in when the log was asociated.
pressure-stream
call an async function for each data event into through stream. manage concurrency as back pressure
engine.io-options-from-url
engine.io-cleint's options / defaults are seriously broken for cross domain.
level-live-stream_issues_7
a test case for live stream stack overflow due to sublevel objects getting sent to stream serilizer.
tailfd
Tail a file. This will continue to work even if a file is unlinked rotated or truncated. It is also ok if the path doesnt exist before watching it
batch-flood-stream
emits batches of data events. grouped based on rate they are emitted and a max batch size.
pinoccio-server
pinoccio command server for your local network. bridges to the pinocc.io api for historical data streams and outside access!
pinoccio-arduino-compile
compiling and uploading sketches for pinccio using the arduino ide from the command line
walkdir
Find files simply. Walks a directory tree emitting events based on what it finds. Presents a familiar callback/emitter/a+sync interface. Walk a tree of any depth.
watchfd
watch events open,change,unlink on all files that are refrenced or become refrenced by path. pause/resumeable
run-schedule
run functions at the right time with the right frequency or know why it didn't work out.
pgschematojson
take postgres schema dump (--schema-only) and read it into a js object with keys and field types
pgschema-deletecascade
uses a pgschematojson object to build a cascade delete batch query for any row
batching-fs-writestream
writes files faster by writing data to disk in chunks rather then one syscall for each call to write as in `fs.createWriteStream` except buffers chunks of data while other writes are pending to batch them to dis
file-should-change
check to see if a file has changed since another file has been changed. useful for refreshing cache files.
deep-property-counter
traverse and object. count all of its properties. generate a key to count map. useful for tracking memory leaks
name-all-functions
read all .js files and add long names to every un-named function. also reverts the changes
first-mate-select-grammar
provides `registry.selectGrammar` for dependants that need it like highlghts.
concurrent-seq-file
makes it safe to work on multiple jobs identified by a sequence at the same time.
concurrent-couch-follower
a couch follower wrapper that you can use to be sure you don't miss any documents even if you process them asynchronously.
retry-log
Process events in a log. Retry them a number of times. Then file them into failed.log or fixed.log
nicely-placed-modification-logs
write modifications/events to append only logs. process those changes sequentially. like an _changes feed but from disk
node-module-resolution
Use to make your own module loaders. A compliant node module loader base without any fs.