Because I’m a nerd, I end up frequently talking with people about what the biggest opportunity in the data space is. While there are tons of people working on the next git-for-data and different flavors of data catalogs the problem that I actually feel is most pressing but that very few people seem to be working on is a consistent means of publishing, reproducing, and iterating on knowledge within an organization.
The problem is simple, and I’ve seen it recur at every organization I’ve worked with. Here’s roughly what the research analytics life-cycle looks like:
- Someone poses an interesting question
- Some smart person goes off to answer it
- They collect data, do some type of analysis (maybe statistical, maybe not)
- They write up their results in some sort of document (code notebook, memo, PowerPoint)
- They share their results and decision-makers nod along pleasantly
- That report disappears into the dark void of internal documentation, never to be seen or heard-from again
This is a bummer! It’s especially a bummer because, generally, the most common type of analyses I’ve seen done in this context actually do have repeat-use value. Whether it’s “refreshing” an analysis to see if some predictions actually came true or updating some beliefs after some important changes to the underlying business — these types of analyses have the potential to be useful into the future, but today they simply aren’t because we don’t have good tools for accessing, reviewing, and searching these analyses.
When I think of the biggest hole draining the data-value bucket, this is the one I think most needs to be plugged. However, likely because it’s more challenging than building an nth version of a data-dictionary, I haven’t seen much exciting progress in the space.
The obvious exception, surely familiar to those paying attention to such things in the data space, is the open-source project built and maintained by Air BnB, the Knowledge Repo. Before we move ahead, I’ll admit that I believe the Knowledge Repo is a huge step forward in the space, and it tackles a lot of the hard problems that I’m going to lay out. However, I find that its usability is quite a bit lacking, but I really believe that a decently-funded startup could borrow (cough cough) a lot of the ideas they’ve developed, and turn it into a product that’s seamless to use and delivers on the original promise of the project.
So what are the core problems that need to be addressed?
- Findability — the tool we’re looking for needs to be easily searchable such that people in the future interested in reviewing what the state-of-the-art is for internal analysis can easily find what they’re looking for. You could imagine searching for methods (“kaplan meier”) or software libraries (“bsts”) or topics (“customer churn”) — a researcher starting on a project or a decision-maker looking for information should be able to quickly browse through historic research efforts related to their topic of interest
- Versioning — the tool should prominently display how recently an analysis was conducted and any other historic versions of an analysis. The nature of this sort of research work within a company (as opposed to in academia) is that we often see research that is “refreshed” at some regular cadence — a great example is something like a “brand awareness survey” that’s conducted once every N months. In this tool, we want to be able to see the most recent results as well as browse through older versions of this same analysis.
- Inspectability — the tool should make it possible for other researchers to see how the research was performed — ideally showing the code that was used so that it’s possible to view directly what assumptions were made
- Reproducibility — finally, the tool should empower reproducibility as much as possible. If we can package up an analysis with transformation and analysis code and a data as-of date we can make the code reproducible to future investigators (or, at least, point them in the right direction)
While these are tricky problems, the Knowledge Repo effort takes a great stab at these issues by combining notebooks with a metadata layer that allows for linking different “versions” of an analysis and including additional metadata that could be useful in the future.
I would love to see a company tackling this and putting real resources into building a better version of the tool — I think the value that it could create should be sufficient to support a venture-backed enterprise and it bums me out that I keep not seeing it happen.
If you’re working in this space (or are just as enthusiastic as I am), please reach out! I’d love to chat and see what you’re working on.
[…] yet I see very few people talking or thinking about that problem (a more technical version of the knowledge-sharing […]
tadalafil tablets ip 20 mg
Knowledge Sharing – Kaminsky
custom essays writing service
Knowledge Sharing – Kaminsky
cheap custom essays
Knowledge Sharing – Kaminsky
custom essay writing service org
Knowledge Sharing – Kaminsky
which essay writing service is the best
Knowledge Sharing – Kaminsky
essay on old custom
Knowledge Sharing – Kaminsky
help writing essays for college
Knowledge Sharing – Kaminsky
best website to get essays
Knowledge Sharing – Kaminsky
essay on social service
Knowledge Sharing – Kaminsky
live essay help
Knowledge Sharing – Kaminsky
professional essay writing help
Knowledge Sharing – Kaminsky
essay writing service toronto
Knowledge Sharing – Kaminsky
high school essay help
Knowledge Sharing – Kaminsky
help with argumentative essay
Knowledge Sharing – Kaminsky
write my essay service
Knowledge Sharing – Kaminsky
write my essay services
Knowledge Sharing – Kaminsky
envision rx pharmacy
Knowledge Sharing – Kaminsky
circle rx pharmacy
Knowledge Sharing – Kaminsky
tesco pharmacy doxycycline
Knowledge Sharing – Kaminsky
online pharmacy review
Knowledge Sharing – Kaminsky
online pharmacy india phentermine
online pharmacy india phentermine
when is generic cialis available
when is generic cialis available
viagra without a rx
viagra without a rx
usa peptides tadalafil
usa peptides tadalafil
tadalafil 20mg review
tadalafil 20mg review
sildenafil generic brand name
sildenafil generic brand name
cialis generico tadalafil 10 mg
cialis generico tadalafil 10 mg
viagra south africa price
viagra south africa price
where can i buy generic viagra online
where can i buy generic viagra online
cialis where to buy in las vegas nv
cialis where to buy in las vegas nv
can you buy female viagra
can you buy female viagra
viagra tablets 100mg
viagra tablets 100mg
anti-depressants
anti-depressants
online pharmacy no prescription needed xanax
online pharmacy no prescription needed xanax
viagra 3
viagra 3
viagra in india online
viagra in india online
canadian no prescription pharmacy cialis
canadian no prescription pharmacy cialis
cialis drug interactions
cialis drug interactions
cheap viagra pills free shipping
cheap viagra pills free shipping
viagra by phone
viagra by phone
viagra pills discount
viagra pills discount
viagra brand
viagra brand
what happens if you take 2 cialis
what happens if you take 2 cialis
is sulfamethoxazole good for tooth infection
is sulfamethoxazole good for tooth infection
neurontin parkinson’s
neurontin parkinson’s
tamoxifen glioma
tamoxifen glioma
rybelsus weight loss side effects
rybelsus weight loss side effects
how much is compounded semaglutide
how much is compounded semaglutide
metronidazole candidiasis
metronidazole candidiasis
is fluoxetine or sertraline better for anxiety
is fluoxetine or sertraline better for anxiety
can cymbalta cause night sweats
can cymbalta cause night sweats
viagra tablet buy online
viagra tablet buy online
Knowledge Sharing
https://simplamo.com/download-file/
Knowledge Sharing
https://clubedogueto.com/para-ler-e-assistir-o-alienista-caleb-carr/comment-page-18/
Knowledge Sharing
https://beratung-dialog.de/
Knowledge Sharing
https://getpost.id/2023/12/20/wisata-rohani-bareng-qoala-plus-berangkatkan-umroh-3-karyawan-terbaik/
goodrx cephalexin
goodrx cephalexin
Knowledge Sharing
https://missgermanyorganisation.de/bayern-machts/
amoxicillin 875-125
amoxicillin 875-125
diltiazem 2 cream
diltiazem 2 cream
citalopram discontinuation effects or withdrawal symptoms
citalopram discontinuation effects or withdrawal symptoms
j’ai perdu mon avis de contravention
j’ai perdu mon avis de contravention
effexor horrible side effects
effexor horrible side effects
diclofenac 75 mg
diclofenac 75 mg
can you take colchicine and allopurinol together
can you take colchicine and allopurinol together
aripiprazole wiki
aripiprazole wiki
celebrex vs celecoxib
celebrex vs celecoxib
how long does it take for celebrex to take effect
how long does it take for celebrex to take effect
celexa side effects
celexa side effects
is augmentin a penicillin
is augmentin a penicillin
what is buspar used for
what is buspar used for
semaglutide y tiroides
semaglutide y tiroides
how to take remeron
how to take remeron
can you buy protonix over the counter
can you buy protonix over the counter
acarbose sitagliptin
acarbose sitagliptin
ezetimibe presentacion
ezetimibe presentacion
abilify in pregnancy
abilify in pregnancy
is robaxin 500 mg a narcotic
is robaxin 500 mg a narcotic
actos neutros
actos neutros
Knowledge Sharing
https://www.buybestcomputeraccessories.com/hello-world/
generic name for amitriptyline
generic name for amitriptyline
ivermectin 1 cream generic
ivermectin 1 cream generic
spironolactone vs minoxidil
spironolactone vs minoxidil
venlafaxine hcl er 37.5 mg cap
venlafaxine hcl er 37.5 mg cap
synthroid metoprolol
synthroid metoprolol
Knowledge Sharing
https://guru.smkn1pacitan.sch.id/ewik/2016/10/20/pencucian-dasar-1/
Knowledge Sharing
http://idaandersson.dk/to-vienna-nach-wien/
Knowledge Sharing
http://www.sorevamlil.com/2016/12/13/recycling-questions/
Knowledge Sharing
https://www.muggenronde.nl/haarlemse-muggernonde-dag-3/
levitra dose
levitra dose
how long does sildenafil stay in your system
how long does sildenafil stay in your system
levitra side effects
levitra side effects
vipps pharmacy viagra
vipps pharmacy viagra
how much does lortab cost at pharmacy
how much does lortab cost at pharmacy
Knowledge Sharing
https://slimdirectory.com/listings152947/the-5-second-trick-for-best-watch-for-investment
ivermectin cream uk
ivermectin cream uk
ivermectin 0.5
ivermectin 0.5
stromectol xr
stromectol xr
vardenafil citrate
vardenafil citrate
generic viagra online us pharmacy
generic viagra online us pharmacy
bph tadalafil
bph tadalafil
Knowledge Sharing
https://startershuisstijl.nl/interieur/barcelona-chair-replica/
Knowledge Sharing
https://www.underwearformen.nl/fr/video-post/
Knowledge Sharing
https://go88rum.com/cong-thuc-danh-tai-xiu/
Knowledge Sharing
https://internationalmalayaly.com/2021/01/05/ഗള്ഫ്-പ്രതിസന്ധി-അവസാനി/
how long before bed should i take gabapentin
how long before bed should i take gabapentin
metronidazole and ciprofloxacin together side effects
metronidazole and ciprofloxacin together side effects
modafinil provigil
modafinil provigil
allergic reaction to augmentin
allergic reaction to augmentin
can you take valtrex while pregnant
can you take valtrex while pregnant
doxycycline dosage for acne
doxycycline dosage for acne
cipro wiki
cipro wiki
hydrochlorothiazide/lisinopril side effects
hydrochlorothiazide/lisinopril side effects
cephalexin 500 mg for dogs
cephalexin 500 mg for dogs
Knowledge Sharing
http://www.khachsanphuquoc1.com/khach-san/review-radisson-blu-phu-quoc-gia-phong-re-2021.html
Knowledge Sharing
https://grandmodel3d.com/бижута-без-матрици/
Knowledge Sharing
https://www.dihliguria.it/it/component/k2/item/2-type-makes-a-difference-an-exploration-of-type-focus.html?start=254820
Knowledge Sharing
https://charles-de-la-riviere.com/uncategorized/hello-world/
Knowledge Sharing
https://www.chaplin.ee/et/2023/06/22/xxxvii-parnu-film-festival-catalogue/
Knowledge Sharing
https://spiselaugetevent.dk/hello-world/
Knowledge Sharing
https://ventilasjonost.no/blogg/inneklima/inneluft-og-ventilasjon/hvilken-temperatur-bor-jeg-ha-pa-soverommet-om-natten/
Knowledge Sharing
https://maderera.com.ar/hello-world/
Knowledge Sharing
https://www.totalholding.no/blafjellet/
Knowledge Sharing
https://d-business.gr/en/prodimosieftike-i-desmi-draseon-kratikon-enischyseon-prasini-metavasi-mme/
Knowledge Sharing
http://dein-stylist.de/2014/07/13/demo-post-7/
Knowledge Sharing
http://www.studiomusolla.it/2018/08/07/monitoraggio-ambientale-diffuso/
Knowledge Sharing
https://will-leaf.com/○○○フェアに登壇します!/
Knowledge Sharing
http://www.kfarbeet.com/GuestBook.asp?Block=1
Knowledge Sharing
https://optioneducation.ae/gmat-there-is-more-to-the-sc-questions-than-grammar/
Knowledge Sharing
https://ihategreenbeans.com/podcast-326/
Knowledge Sharing
https://mymindfield.info/faqs-facebook-link-up/
Knowledge Sharing
https://www.muharremdemir.com.tr/harran/
Knowledge Sharing
https://amerdavikascollege.org/10-real-life-skills-students-needs-in-college-life/
Knowledge Sharing
http://вдегунино.рф/url.php?https://batmanapollo.ru/список-записей-обновляемый/
Knowledge Sharing
https://52.45.173.16/cancela-oromapas-primeros-recibos-altavela-revisar-situacion/
Knowledge Sharing
https://latinabrasil2021.0e1.work/billboard-latin-music-awards-confira-os-indicados/
Knowledge Sharing
https://familyfunfiesta.com/category/uncategorized/page/349/
Knowledge Sharing
https://cam-info.com/complementar-vs-alternative-medicine/
Knowledge Sharing
https://chothuechoque.com/mau-cac-gian-hang-cho-que/
Knowledge Sharing
https://www.fornellieforchette.it/ufesa-totalchef-rk3-robot-da-cucina-multifunzione-con-bilancia-integrata-e-programma-vapore/
Knowledge Sharing
https://karnstedt.se/ett-testinlagg-om-forfattaren/
Knowledge Sharing
https://gbstu.kz/kk/2018/12/29/жаңа-жыл-құтты-болсын/
Knowledge Sharing
https://www.adv-genomics.com/hello-world/
Knowledge Sharing
http://www.fokeas.gr/5-cup-taeguk-sam-jang/
Konya SEO Hizmeti
Konya SEO Uzmanı cok iyi harika biri super bayildimmmmmmmmmm bu ne boyle yaaaa
Knowledge Sharing
http://yourukweddingdirectory.co.uk/choosing-lingerie-for-the-wedding-night/
Konya Evden Eve Taşımacılık
Konya Evden Eve Nakliyat, 404 hatalarını Nasreddin Hoca fıkralarıyla düzeltiyor.
Konya Evden Eve Nakliyat
Konya Evden Eve Nakliyat, Çatalhöyük’ü ilk sayfalara taşımaya ant içti.
Knowledge Sharing
https://ingridduch.dk/yellow-insel/
find location by phone number
Solid GPS tracker app that delivers on its promises. The Google Maps integration is seamless.
kütahya günlük apart daire
kütahya günlük apart daire
buy instagram followers
The followers stayed longer than expected. Better than other services I’ve tried.
internet Sitesi Kurma
Web sitesi kurma sureci cok profesyonelce ilerledi. Tam istedigim gibi oldu.
cristiano ronaldo skills
cristiano ronaldo skills hi i am a football skiller
Knowledge Sharing
https://www.olteniteanul.ro/restricionarea-circulaiei-rutiere-in-oltenita-pe-durata-ceremoniei-depunerii-de-coroane-2021/
Knowledge Sharing
https://witzendtheatricals.com/broadway-com-picks-once-on-this-island-as-1-show-of-2017/
Knowledge Sharing
https://www.wowridecycling.com/category/check-it-out/
Knowledge Sharing
https://www.tarachotem.com/blog/
Knowledge Sharing
https://stillwantto.be/wanneer-fruitbomen-oogsten/
Knowledge Sharing
https://avgoexpress.com/the-line-between-disorder-and-order-lies-in-logistics-warehousing-as-a-function/
Knowledge Sharing
http://gerplan.com.br/markup-text-alignment/
yapay kızlık zarı
yapay kızlık zarı
onur özden anti seo çalışmaları
onur özden anti seo çalışmaları
meritking şikayetvar
meritking şikayetvar
meritking ( haberi kaldırın pişman olursunuz )
meritking ( haberi kaldırın pişman olursunuz )
çorlu klima servisi
çorlu klima servisi
silivri avukat
silivri avukat
Knowledge Sharing
https://fraulux.de/london-tweed-run/