topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Monday February 10, 2025, 11:26 pm
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Last post Author Topic: I'm thinking of going primitive, with discursion into zettelkasten  (Read 552550 times)

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #850 on: November 19, 2020, 03:16 AM »
And for anyone using VS code, I just found a new model built on top of it - Dendron (https://www.dendron.so/).  I can't say too much about it yet, but I'm definitely going to take a look to see what's different between that and the others.
It's designed to have a strong hierarchy, reflecting a folder structure.

Didn't suit me, even if I had been willing to use VSCode.
I'm OK with opening VSCode for one purpose and then closing it again, but that wouldn't suit any Note app.

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #851 on: November 19, 2020, 04:01 AM »
@Dormouse- that's a no-brainer for me too.  It's one of the reasons that I stopped depending on Obsidian pretty quickly, and moved over to the Frankenstein model that I have (Using Foam and Memo extensions).  But the plugins with Visual Studio Code has been working really well for me.  I wish that I had the ability to embed references- it's one thing that would have solved some issues I've had.  But it has worked out fine, especially with previews inline.

As you know, I have a much more nuanced approach to databases.
I'm OK with Writemonkey 3 with its coterminous files. I have my data in files and the extra features that come from the database (which include, I assume, its very good folding). Most writing programs have some sort of database; some also have files and some save much of the data in files.

But the Writemonkey approach to the database is far superior to that in Obsidian:
It's explicit that everything is in a database, with coterminous files being a selectable option.
The location of the database can be changed.
You can have more than one database.
You can run more than one instance at the same time.
This makes it easy to have a tiered approach to privacy and security.
Even so there are still some reports etc I wouldn't use Writemonkey for.

Obsidian has never been totally clear about what is saved where. Some is saved in the vault folder. But a large part has been moved to a json in a system folder.
It talks about vaults, and how every fault is totally separate, but then the data from every vault is in the same system folder in readable format.
It seems hard coded to only look at one location. If it's empty it writes another set.
And it has just announced saved searches. So a reiteration of the same question in my head - 'What is saved, where?'. I'm sure the answer will be that central json, but I'll have to run a few searches and do a file check to see exactly what's there. And will only be quick because I will know what I'm looking for and can do a search.
For me, it's straightforward poor design and not thinking through the implications of choices. Fixing a small immediate problem - today easier, tomorrow harder, and just don't think about next week.

Most of the immediate problems can be overcome. I control what I use it for. I can remove and encrypt the system file between uses (though that would always irritate me). And I can to a detailed test of every update (though they are weekly, more or less; I think I'll make it less going forward, updating is starting to feel too much effort for a small gain).
The big question about any developing software is where it's going to end up and how confident you can be about both quality and direction. This is where I now favour your Frankenstein model, though my version may look completely different to yours. Obsidian might be some part of it, maybe.
« Last Edit: November 19, 2020, 04:58 AM by Dormouse »

wraith808

  • Supporting Member
  • Joined in 2006
  • **
  • default avatar
  • Posts: 11,192
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #852 on: November 19, 2020, 07:53 AM »
As you know, I have a much more nuanced approach to databases.
I'm OK with Writemonkey 3 with its coterminous files. I have my data in files and the extra features that come from the database (which include, I assume, its very good folding). Most writing programs have some sort of database; some also have files and some save much of the data in files.

I'm actually not opposed to databases as it might seem.  I don't care about something being in a db, if I also have it in files.  It's the reason that I still use Scrivener, Writemonkey, and Cintanotes.  In all three cases, I have the content of the database/project replicated in plain text elsewhere.

Obsidian has never been totally clear about what is saved where. Some is saved in the vault folder. But a large part has been moved to a json in a system folder.
It talks about vaults, and how every fault is totally separate, but then the data from every vault is in the same system folder in readable format.
It seems hard coded to only look at one location. If it's empty it writes another set.
And it has just announced saved searches. So a reiteration of the same question in my head - 'What is saved, where?'. I'm sure the answer will be that central json, but I'll have to run a few searches and do a file check to see exactly what's there. And will only be quick because I will know what I'm looking for and can do a search.
For me, it's straightforward poor design and not thinking through the implications of choices. Fixing a small immediate problem - today easier, tomorrow harder, and just don't think about next week.

Most of the immediate problems can be overcome. I control what I use it for. I can remove and encrypt the system file between uses (though that would always irritate me). And I can to a detailed test of every update (though they are weekly, more or less; I think I'll make it less going forward, updating is starting to feel too much effort for a small gain).
The big question about any developing software is where it's going to end up and how confident you can be about both quality and direction. This is where I now favour your Frankenstein model, though my version may look completely different to yours. Obsidian might be some part of it, maybe.

You bring up some good points.  I haven't opened Obsidian in a long while; at the time that I did it, it seemed that all files were in the Obsidian folder, i.e. if I created files in VS Code, Obsidian seemed to pick it up and pick up the changes if I had both open.  I apparently (a) haven't  kept up with Obsidian changes, or (b) was just unaware that it stored other files in other locations.  That's really concerning to me, and I might just go ahead and uninstall it as it's sort of withered on the vine in my workflow.

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #853 on: November 19, 2020, 08:23 AM »
it seemed that all files were in the Obsidian folder, i.e. if I created files in VS Code, Obsidian seemed to pick it up and pick up the changes if I had both open
It will still do this, and the files themselves are just as they were and in the same location.

I apparently (a) haven't  kept up with Obsidian changes, or (b) was just unaware that it stored other files in other locations.
The big change came, I believe, in 0.8.7 when some files were switched from the vault folder to a system folder. Originally described as some data, and more recently as metadata, the amount stored has steadily increased as features have been added.

I'd prefer files alone, but I don't object to  this in principle. I would have wanted detailed disclosure and much preferred the approach of keeping this 'metadata' in the vault folders.
I might investigate what happens if I leave the system folder where it is but just move the vault 'metadata' for vaults I want to keep secure to an encrypted space (moving it back when I want to access that vault).

The big hit is to my confidence in the developers. I was anticipating subscribing to their Sync service when it came out (e2e encryption, secure cloud) - don't need it but I'd rather contribute if I'm using it a lot - but there's no way I'd trust their implementation now.

I might just go ahead and uninstall it as it's sort of withered on the vine in my workflow.
No obvious reason why not, if you don't use it.

I like the way transclusions work.

superboyac

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 6,347
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #854 on: November 19, 2020, 12:04 PM »
Just out of curiosity …

What are people doing with all this information they’re curating and cataloging with these various pieces of software? To what purpose? Or maybe even: to what avail?

I’m more curious about the individual “business” use cases rather than the supporting technology. Technology and solutions that offer varying degrees of utility aren’t that difficult to run down. God knows there’s tons of software out there. But the reasons to employ said technology can sometimes be less obvious. At least to me.

So help me out. What is/are your goal(s). What’s it all for? What are you guys doing with all this information you’re gathering?  :)

40....
When I learned about this, the thing that intrigued me the most was how prolific that Lurhman guy was due to using this system.  Prolific in terms of churning out books.  I also want to continue writing books, so that is my end goal.  I remember writing my first set of books how annoying and time=consuming/frustrating it was to organize everything, and then once organized, even keeping track of your thoughts and notes and edits, etc.  So the idea of using a system such as this to capture your thoughts and then later to recover it and put quickly together in long-form or book form, is the ultimate goal for me.

I've been an unorganized notetaker for many many years, most of my life.  But their all over the place.  If I wanted to put something together based on my thoughts, I have to search and find everything, then reread it (because they are long and disjointed), then re-understand my original points, then organize, then edit.  Supposedly, this allows us to skip all that once the "zettels" are created and its just a matter of following each zettel (which should already be concise and easy to read/understand) and they are already linked, so you can just churn out books...theoretically.

Now, in practice, much of the last 2 years of the exercise was just to see if this even works with the software and tools etc.  Nothing really "took" for me until i saw that software Neuron that I am loving.  And the thing there was that it syncs with my local files and presents a very nice looking website instantly with everything there.  The softwares technically do the same, but something about the aesthetic of neuron really is working for me.

So now I am just writing away, and hopefully some nice books will come out of it.

Business wise, I don't see many applications.  Would employees really use such a tool?  Not really.  Even if they were research oriented, it still takes a rare kind of dedication to use it all (the markdown, the linking, the curating) it's all very rare.  Maybe if the system could be more automated somehow, but still, I struggle to find a good application.  Actually, in the neuron forum, one of the users presented it to a company, and he said there wasn't much interest at all, lol. 

What's wrong with us?  Why do we write and write and curate and write?  I don't know, might be a mental problem.

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #855 on: November 19, 2020, 02:37 PM »
Why do we write and write and curate and write?
Virtually all the money I've ever earned has depended on my writing. Curating too.

wraith808

  • Supporting Member
  • Joined in 2006
  • **
  • default avatar
  • Posts: 11,192
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #856 on: November 19, 2020, 03:11 PM »
Why do we write and write and curate and write?
Virtually all the money I've ever earned has depended on my writing. Curating too.

I'm not in that position, but I've made quite the bit of side hustle money with my writing.

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Deleting contents of ObsidianCache
« Reply #857 on: November 19, 2020, 03:44 PM »
I've now established that deleting (or moving) contents of ObsidianCache has no effect on Obsidian's memory for the existence of previously opened vaults or their location. They still open as normal (presumably recreating the ObsidianCache file from the files).

Changing the name of the Vault folder loses the memory of that vault and changing it back after Obsidian has been closed does not restore it. Presumably one of the other cache files stores names and locations of available vaults from the last session, and there's a check for their continued existence.

So deleting the vaults I want to keep secure from ObsidianCache should be sufficient for my purpose.
Only aggravation is having to check individually the cache names against the vault names.
Assuming I understand what's going on well enough.

wraith808

  • Supporting Member
  • Joined in 2006
  • **
  • default avatar
  • Posts: 11,192
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #858 on: November 19, 2020, 05:38 PM »
Could you perhaps post your thoughts on some Obsidian forum to see if someone can validate your approach?

40hz

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 11,859
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #859 on: November 20, 2020, 09:01 AM »
What's wrong with us?  Why do we write and write and curate and write?  I don't know, might be a mental problem.

LOL! I suspect that of myself sometimes. More often than I’d like actually.  One professor described my “problem” as an “aspiration to achieve omniscience.”

I eventually gave up on trying to create an artifact and just constructed a classic memory palace for myself. Something I’ve since stopped worrying about externalizing for posterity. But I find the software based approach some are taking as
incredibly interesting just the same.

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #860 on: November 20, 2020, 04:05 PM »
“aspiration to achieve omniscience.”
Nothing wrong with that. Just one end of a spectrum. The better end usually.
With total ignorance being the midpoint, and being wrong about everything at the other end.
Life makes it hard for anyone to maintain a comfortable ignorance, which leaves you with a choice of directions.

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #861 on: November 20, 2020, 04:41 PM »
Could you perhaps post your thoughts on some Obsidian forum to see if someone can validate your approach?
With any particular outcome in mind?

Problem is that the Obsidian forums aren't great at analysis.
And this is an issue only to a tiny minority (possibly only me).
I would have expected more informed responses when I first raised the issue if more informed responses were to be had. And no comment from developers at all.
I have a few more tests to do, and recheck on the latest version, and then I'll probably put a small post on the forum in case anyone else is ever interested.

I mentioned it here as a follow-on to my post explaining my change of direction, to indicate that there were simpler methods of managing it. Certainly it makes it easier for me to continue using Obsidian for most notes, but does nothing to move me from Frankenstein.

Which had advantages anyway. I worked out how to do multi-coloured highlights in markdown fairly easily, but simply using RTF is easier still and it is only a temporary stage for me, not the final document. At some point, I'm sure someone will come up with a better form of plaintext for the average word processor user. It will give up document management and document styling features (the latter are rarely used by most, and the former are little used by the average user) ave but keep the text control and styling. It will give up code blocks. Maybe it will be called marktext.

panzer

  • Participant
  • Joined in 2008
  • *
  • default avatar
  • Posts: 941
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #862 on: November 20, 2020, 05:10 PM »
Using Obsidian with Termux and VIM:
https://www.thegadhi...with-termux-and-vim/

wraith808

  • Supporting Member
  • Joined in 2006
  • **
  • default avatar
  • Posts: 11,192
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #863 on: November 20, 2020, 06:46 PM »
With any particular outcome in mind?


I was thinking that it would help you to know where you stand, and if you were covering all your bases with your approach. But if they are less than helpful, I can see why you'd not do that.

40hz

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 11,859
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #864 on: November 21, 2020, 09:56 AM »
I'm sure someone will come up with a better form of plaintext for the average word processor user. It will give up document management and document styling features (the latter are rarely used by most, and the former are little used by the average user) ave but keep the text control and styling. It will give up code blocks. Maybe it will be called marktext.

I don’t think it would require an entirely new plaintext format. I suspect it could be adequately handled by XML. The real challenge would be establishing the schema and taxonomies. The mechanics and details of the markup itself aren’t the issue. It’s the meta framework that represents the real work to be done.

Kinda like the old joke about how employing a computer and database for your average problem is often like hitting a fly with a 20-lb sledgehammer.  Easy enough on the face of it - except for the part about how to get the fly to land.  ;D

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #865 on: November 22, 2020, 04:08 PM »
I suspect it could be adequately handled by XML
If XML were a contender markdown et freres would never have been invented.

The number of commands most people need is small, it's just that markdown doesn't include them all, and some of its choices are distinctly odd and hard to use. Apart from other features which presumably fitted Gruber's original idea of purpose and target users, but aren't wanted by most WP users.

wraith808

  • Supporting Member
  • Joined in 2006
  • **
  • default avatar
  • Posts: 11,192
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #866 on: November 22, 2020, 04:37 PM »
I suspect it could be adequately handled by XML
If XML were a contender markdown et freres would never have been invented.

The number of commands most people need is small, it's just that markdown doesn't include them all, and some of its choices are distinctly odd and hard to use. Apart from other features which presumably fitted Gruber's original idea of purpose and target users, but aren't wanted by most WP users.


Yeah, that was my thought too.  The few that do use a plain text format other than markdown (and sometimes in conjunction with markdown) use json or protobuf that I've seen.

BGM

  • Honorary Member
  • Joined in 2008
  • **
  • Posts: 563
    • View Profile
    • bgmCoder DC
    • Read more about this member.
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #867 on: December 04, 2020, 10:09 AM »
Have we mentioned Zettlr yet?
https://www.zettlr.com/download/win32

It is a notebook app with markdown designed for writers.
I haven't tried it yet, but I've downloaded it and plan to preview it.  (I'm still using TreeDBNotes because I've never found a suitable replacement)

superboyac

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 6,347
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #868 on: December 04, 2020, 12:44 PM »
Have we mentioned Zettlr yet?
https://www.zettlr.com/download/win32

It is a notebook app with markdown designed for writers.
I haven't tried it yet, but I've downloaded it and plan to preview it.  (I'm still using TreeDBNotes because I've never found a suitable replacement)
Oh yes, discussed a lot.  I prefer using Zettlr to write my content, fyi.  And then I prefer Obsidian to navigate my content.  And ultimately, I prefer Neuron to display my content on a website.

panzer

  • Participant
  • Joined in 2008
  • *
  • default avatar
  • Posts: 941
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #869 on: December 04, 2020, 03:41 PM »
Zettelkasten for Indie Devs and Product Managers:
https://blog.notepla...ttelkasten-for-devs/

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #870 on: December 04, 2020, 07:08 PM »
I'm still using TreeDBNotes
TreeDBNotes is very different to all of these, so you'd probably need to have decided to move on. And if that's your starting point, you'll know what you want to keep and what you'd like to add.

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #871 on: December 04, 2020, 07:15 PM »
I prefer using Zettlr to write my content,
I'm often not very fussed about what I actually write in. Sometimes my choice will depend on a feature I want for that particular use.
For instance folding (which I use a lot):
Typora doesn't seem to have it;
Zettlr is better (headings);
Obsidian is better still (headings and outlines)
and WriteMonkey is best (no obvious limitation).
I admit I might have missed a use somewhere above - I've not tested in detail, just what I've found in use.

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #872 on: December 04, 2020, 07:24 PM »
One huge issue for me, having many files, is the whole file explorer set up. None of these programs are great. Obsidian possibly best because it has the greatest variety of ways of finding files (folder, search, tags, regex, graph), but convenience in everyday use is important.

Another issue is how well the editor/program integrates into a system where there are many types of files. Again I don't think any of them are great for doing this.

Nod5

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 1,171
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #873 on: December 05, 2020, 04:01 AM »
Another issue is how well the editor/program integrates into a system where there are many types of files. Again I don't think any of them are great for doing this.
Yeah, there is a lot of friction to overcome there. I have an AutoHotkey script setup: I put no-markup filepaths or filenames in the plaintext notes. Later I select a whole or part of such a string (or put the cursor inside it) and press a hotkey. The script detects if there is a unique file anywhere matching the string pattern and takes action depending on filetype. E.g. open PDF in pdf viewer, open source code file in VS Code and so on. If multiple files match action alternatives are shown. If no file is matched alternatives to open up a file search in Everything or do a Google search are shown. Since this works on any text selection anywhere I can use the same approach across different apps, local or web based. For example I use it also in notes written in Google Docs, in effect links from Docs to the local filesystem. I considered making it a NANY tool this year but the thing is still evolving and is very tied to my own note taking setup and how I tend to use the target files, so difficult to make into a more general application yet. But I think this kind of customizable inbetween tool is the best option, since it is unlikely that any specific note taking app will also be a best fit for how you want to deal with various other types of files.
« Last Edit: December 05, 2020, 04:10 AM by Nod5 »

Dormouse

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,961
    • View Profile
    • Donate to Member
Re: I'm thinking of going primitive, with discursion into zettelkasten
« Reply #874 on: December 07, 2020, 08:12 PM »
I prefer Obsidian to navigate my content
Which features of Obsidian do you use when navigating?