Scribus Forums

Development => Features => Topic started by: jack_cat on August 23, 2018, 05:40:29 AM

Title: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on August 23, 2018, 05:40:29 AM
Being my first post, I put this in the general discussion before I realized I should have put it here in "features". Sorry.
So, this is my second post, same as the first.

I am working on a book with many end-notes. Scribus is generally lame in processing footnotes / endnotes AFAIK.
A very useful feature which would get us half-way there, and probably not need much programming time (??), would be

Insert > Character > Footnote Number
All this would do is put a superscript number in the text. Then, when another footnote is added ahead of it,
the numbers would update automatically throughout the file in ALL text boxes. Shouldn't be much tougher than page numbers to implement. That would certainly save re-numbering 75 superscript footnote marks in the main text every time I stick another one in!!! Yaaahhggg!!! (Tears out handfuls of hair...) I sure would like to be able to mark the end note numbers in the text as I go, instead of going back and doing it after I'm sure (ha!) that the file is finished (Murphy's law: right after I do that I will make another change. Anyway, the after-the-file-is-finished method causes text box overflows and more formatting work.)

For extra bells and whistles, the function could output a report of all footnotes and their page numbers, a snippet of x characters of text just before the mark, and any other useful info (?). It might even output this report to an SLA file template which could become the end-notes section. (I'm dreaming...?)

Of course, the end-note counting function would also have to be able to deal with moving the sequence of the text boxes around in revising the material, cutting a text box out and re-pasting it later in the Chapter, or dragging it from one page to another with the mouse. Therefore the end-note counting engine would have to verify the absolute position of the text box in the file as it will be read, and not be based on the sequential numbers of the text boxes in the order they are created. 

Because the work I am doing is graphics-heavy, I use a separate file for each Chapter, as the file cludges down after about 50 pages. If I were not doing this, I would want to also be able to define sections in which the footnote count could be started afresh for each Chapter.

While I'm at it: another possible, and similar, routine, would be to highlight a word in the text and click:
Insert > Character (?) > Index reference.
Then a report would output all index references with their page numbers and maybe a text snippet of x characters, to a separate file, to be processed into an Index.

I wouldn't mind doing the extra work of creating the notes and index as separate files, if these useful features were present. By the way, I am composing text directly in Scribus as the text and graphics are so closely related, and so it is pointless for me to compose text in OO and then import it. The graphics, of course, require a separate work flow and then I import them.

Thanks for all the great help, everybody. Scribus is a great tool, I am very happy with it.

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: a.l.e on August 23, 2018, 09:21:17 AM
hi jack,

the development version 1.5 does have footnotes and endnotes.

they are still an unstable feature but they are in tthere!

if you want to test them, you can download scribus 1.5 from the scribus download page and install it alongside the stable version.

ciao
a.l.e

p.s.: it's not so important in which category you post... this is no high traffic forum... but having two times the same topic is a bit of awkward, so i deleted your other post : - )
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on August 24, 2018, 06:16:42 PM
Thanks a.l.e.

All of my many files (accumulated last 3 years) are made with 1.4.6, and I understand that 1.5 uses a new file format not backwardly-compatible; this and the report that the footnote functions are still incomplete has discouraged me from making an experiment. What I have been able to find and read on the new version shows only a footnote function, in which the footnote # is directly tied to a linked footnote text box at the bottom of the page, and I find nothing about end notes - if you can point me to the documentation on end notes it would at least be informative, thanks.

In any case, my end notes will of necessity be in a different .sla file in assembling my final draft, because of the main chapters being so graphics-heavy that each must be a separate file. To make an assembled draft, I collate the PDF files which I export. Therefore, a function which produces linked end notes in the same file does not promise to be terribly useful for my purpose, as I would have to cut them out and move them to the back of the book by putting them in a separate file.

I had the same graphics-heavy cludge factor when I tried to do an early version in OO, which is why I searched for and found Scribus when friends told me only InDesign or Quark would do the job; I was disappointed but not terribly surprised to find the same memory issue with Scribus, even with a relatively new computer with what used to be an unimaginable amount of memory. It seems to me that the developers (bless their little open source volunteer hearts doing such a wonderful job, and I don't complain, merely comment on my findings) need to stay aware that a Scribus project such as mine - which I naively thought that I could do with a word processor in the beginning - must involve a number of different .sla files which there is no way to link together dynamically, because of the memory issues. Yet I do require end notes - which at this time, AFAICT, can only be done with individually written and painfully re-numbered individual super-script numbers in the text, and the end notes themselves simply written in another file. I don't have a problem with re-numbering the notes in the end-note file on revision, because they are all just one-line references, with the numbers at the beginning of the line; although it is a pain, it can be done in a relatively short time. I did complete TOC, end notes, bibliography and index on an early draft, all non-dynamically by hand, and I can do it again, but it takes two or three days.

The periodic (ahem, I know I ought to be able to do it just once, but I revise a lot after I think I'm done) re-numbering of the super-script numbers embedded in the text, however, is a royal pain, like hunting rats on the screen, with the added fact that it is very easy to get careless and lose their font attributes in doing so, whether on the main screen or in the story editor. The footnote function in 1.5 as far as I have read the documentation so far, appears to be based on some concept which is (a) so complex as to be a programming challenge, (b) doesn't account for the necessary multi-file work flow, and (c) isn't pointed toward the simple and direct function which I propose, which I believe (although I never programmed anything that worked, myself) should be almost as simple to implement as the page number function (I was amused to find the funky-but-nifty workaround for using the page numb function to number 10-to-a-page tickets), and if I could find a way to just get any kind of consecutively-numbered "element" that I could adapt for my purpose, I would be happy!!!!!!

!!!!! Yes, I would. Just a simple self-updating numbering function, no other dynamic linking required.

I got as far as Document-Setup > Document Item Attributes > Name: Endnote > Type: Integer, and couldn't figure out how I could go any farther - if this is indeed a possible way to get consecutively-numbered dynamically updated number sequences into the text, please tell me how to do it.

Thanks very much! Back to work now!
jc
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on August 24, 2018, 06:44:26 PM
a.l.e. :
You wrote in another thread:

"if you can put up a list of features you would like to have in master pages, i can check what i can do with a python script...
"

Can you make a python script to do dynamic numbers such as I proposed above ? ? ? just dreaming out loud...
thanks
by the way I think the master document idea is wonderful but that's another story...
jc
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: a.l.e on August 24, 2018, 06:45:06 PM
Footnotes: the menu entry is called "insert foot/end note"...

As said, I don't use it myself, even if I must have tested it at sometimes in the past.
Here is a hint: I think that you have to first create a note style to be able to create end notes.

The feature -- as programmed in Scribus -- is very powerful but -- if i recall correctly -- needs some more work for usability and for stability.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on August 25, 2018, 03:26:38 PM
This page:
https://wiki.scribus.net/canvas/Footnotes
does show one screenshot in which there is a checkbox for either footnotes or end notes, with "footnotes" checked.
The procedure for footnotes is explained, the procedure for end notes is not mentioned again.

OK, I understand that in order to find out how it works, I will have to download 1.5x and check it out for myself.
Thanks!
jc
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on August 25, 2018, 11:46:31 PM
As I have written in other threads I now use an external toolchain, including Atom editor plus Markdown Packages, for external preparation of content to inject into Scribus using Scribus as a layout engine rather than prime editor.

To address your example requirement I have just run an experiment in Atom to inject footnotes into a markdown document.  I installed Atom package markdown-footnote and I believe this might meet your requirement to automatically reorder footnote references.

Here is reference to the package.

https://atom.io/packages/markdown-footnote

The Atom packages in use include:

Markdown Footnote (Ctrl+Shift+F adds footnote)
Markdown Preview Enhanced
Markdown Writer
and others to support my workflow.

This approach should work with an earlier version of Scribus since latest Scribus footnote feature is not used. All content editing is external and finished objects are imported into Scribus.

[Later edit]

I now see that Markdown Writer package has the same feature but does not provide hot keys for this function. However, probably hot keys binding could be added so that you only need Markdown Preview Enhanced and
Markdown Writer
to be installed.
Plus Pandoc.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on August 26, 2018, 04:13:08 PM
Thank you, Dragonfly.
I am very grateful to receive a suggestion for a working procedure.
I have high hopes and have downloaded and installed Atom.
So, learning curve ahead. I am reading the documentation, (but I won't finish today as I have a work day.)
So far I am not yet clear on how this workflow is going to go or how Scribus is going to read Atom's markup, and hope that this will become apparent. And so this post is written from a place of just beginning to find my way in the dark.

So of course I may answer these preliminary questions just by reading the docs, hope so. And if you think it will be obvious, then I will probably get it in a day or two. But, first question:

Does this then require one continuous text file to be imported into Scribus so that all of the footnote code to be included in a single Scribus file is contained within a single Atom file? I ask this because in that case I will have to plan the work flow somewhat differently (which is perhaps lame and ad hoc anyway, so suggestions welcome). Much of my text consists of captions for graphical information, with source notes, which consist of individual snippets like this:

Ex. 2.02     Graphic showing blah-blah-blah from Source XYZ [end note # superscript]

which I typically put in a text box that does not flow to another and group with the graphic so as to move them around. If these must be all in a single file flowing from one text box to the next, that will be interesting, not impossible, I'm sure.
And then, in between the examples, I have blocks of explanatory text which often have a note at the end of each sentence.

(When I started on this set of related projects several years ago, I tried composing text apart from the graphics with the purpose of assembling later, when it became apparent that simultaneous text and graphics together were unmanageable in a word processor, but I found it much more convenient to use Scribus as a WYSIWYG, outputting it to PDF frequently to get a better visual check, as the visual composition of each page affects the order of material in order to take advantage of the layout of facing pages. I have so far not been able to plan all of this outside of Scribus and just dump it in and arrange it. If this is turns out to be an obstacle to this footnote add-on then I will reconsider it, and suggestions are of course welcome.)

Could you be so kind as to provide a sample of the output including the markdown-footnote code?
And maybe a screen shot of it from within Atom?

Anyway, I am working on it and perhaps by Tuesday or Wednesday I will have made some progress.

Thanks!!
jc
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on August 26, 2018, 05:18:31 PM
Dragonfly, I am hunting up your other posts re Atom on the scribus forum, to see what I can learn.
So far it is mostly Greek, as I am not a programmer! (sorry) (I can write raw HTML however if that will be useful.)
I do have Atom installed with the several packages you mentioned.

here is a preliminary effort:
temp.txt generated with Atom:

This is a sample footnote [^9685]
[^9685]: source: blah blah etc.
text continues with second footnote [^eb6b]
[^eb6b]: source two blah blah

I don't yet know how to use this. Clearly I have to do something else with it than just dump it into Scribus.
I put it in a text box in Scribus using "get text", and it does ahem nothing... yet, anyway... except print as is,
with brackets and markup code.

thanks
jc
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on August 26, 2018, 07:02:04 PM
I have started you along this path and I hope you will find the exercise useful.
First question: are you using Windows/Linux/Mac?
My advice refers to Linux notation but the tools I refer to can be used across Window/Linux/Mac.

The reason I decided to adopt a toolchain integrated with Scribus was to develop a more agile workflow to accommodate frequent changes in documents to be published.  As you know Scribus can be used as a dedicated content editor but it is not ideal since we have to dive into properties windows when significant changes are required.  It was for this reason that I decided for my purposes to leverage Scribus as a layout engine and not as a content editor.

You have started by installing Atom.  It is quite easy to install Atom packages which extend Atom's functionality.   At current count there are over 7,800 packages to choose from.

...

Now to first answer your immediate questions.

(1) Any markdown file should end with the extension *.md and not *.txt. You will see no effect with a text file.

(2) You need to install an Atom package - Markdown Preview Enhanced.

(3) Although you may have installed packages you will need to Toggle to see the Preview Window (WYSIWYG) in the right pane before it will be sent to Scribus.

(4) Note the advice below to run Window:Reload after installation of packages to refresh Atom, before the packages are seen in Packages menu. And packages need to be toggled to enable them.

(5) Be patient about the final stage pushing Atom content into Scribus. Learn the pre processing stages first. Further advice will follow on Atom -> Scribus link.

...

Let us start by installing a few useful Atom packages.

In addition to Atom you are recommended to install Pandoc which is a generic document converter.

It is helpful if you start by installing the Atom package Project Manager Project Viewer.  This allows multiple project assets to be viewed in Atom left pane.

You can navigate through all Packages by going to Atom topbar > Packages and using the search facility.

And here .. https://atom.io/packages

But with the large number of packages available to choose from it is easier for a new user to narrow down the search options by a google search for a required feature. Use a google pattern in your browser .. some examples follow ...

Atom NEAR markdown .. you will also find a galaxy of tutorials
Atom NEAR footnote
Atom NEAR endnote
Atom NEAR snippets

If you navigate to topbar View > Toggle Tree View you can show/hide the left navigation panel.

Referring to my own history of installation commands I had installed Project Manager Project Viewer by running this command ..

apm install project-manager

apm install project-viewer

Late edit: Advice later in this thread was updated to install packages project-viewer and atom-material-ui


In the command terminal the installation is confirmed.

Now after installation of any package the Atom instance has to be reloaded before the installed package is seen in the topbar Packages menu.

In Linux we can reload by hitting the hot keys [Ctrl + Shift + P]
or in Atom .. topbar > Packages > Command Palette > Toggle

Either usage will bring up a package search window.

Now type in "Window" and choose the option Window:Reload

This will reload Atom and now the package Project Manager Project Viewer will be seen to be added to the Packages menu.
The submenus are ..
List Projects
Save Project
Edit Project
Edit Projects
Update Projects



If you choose the submenu "Edit Projects" this opens a configuration file where paths to different projects can be defined.  The path to this file is

/home/username/.atom/projects.cson


This gives you the project management framework to create folders and files for one or more projects.

...

Next we add Packages for using markdown. We use the same procedure as above.

apm install markdown-preview-enhanced
apm install markdown-writer
apm install markdown-footnote

And after installation .. again .. Window:Reload    (n.b. not Windows)
...


You might create a new project folder named "test" to experiment with features.

In project folder "test" (seen in left navigation panel) you can create a new file .. example.md

At the top of every markdown file a metadata block is inserted. Follow the markdown syntax guide.

A basic block might be for starters ..

---
title: 'Integrate Atom with Scribus'
author: 'jack_cat'
date: '26th August 2018'
---

Now you can experiment with the basics of markdown syntax.
Refer to markdown guide.

The key package to enable (after you have installed it) is Markdown Preview Enhanced.
Look at topbar Packages > Markdown Preview Enhanced > Toggle
and you will see a content preview window in right pane.

Any content you insert into your markdown file will be seen in the Preview pane.

...

To go to the completion, in the Preview window right click on the content and you will see

Open in Browser
HTML
Chrome (Puppeteer)
PhantomJS
PDF (prince)
eBook
Pandoc
Save as Markdown
Image Helper
Sync Source


You can start with "Open in Browser" but later you can try the advanced features available in Pandoc (more on that later).  You can output to web or to Scribus. Pass over the other options while you are learning.

...

To avoid composing large documents you can structure your document into a tree structure in Project Manager.

test >

    merge.md    (concatenating the assets below using @import)
   
       sections>
           section01.md
           section02.md
           section03.md
           section04.md
           
      images>
          image01.jpeg
          image02.jpeg
          image03.jpeg
          image04.jpeg
                   
      vectors>
          image01.svg
          image02.svg
          image03.svg
          image04.svg
         
Now in merge.md you can concatenate content (text and images) by using a series of @import commands embedded in merge.md.

@import "/sections/section01.md"
@import "/images/image01.jpeg"

@import "/sections/section02.md"
@import "/images/image02.jpeg"   


Note that sections might also contain @import commands so you can build a tree structure of imports.  In merge.md you can for test purposes also comment out entire blocks of @import commands (wrapped in HTML comments tags .. <!-- ... -->) so that they are not concatenated and reduce processing/memory load while previewing.

<!--
@import "/sections/section02.md"
@import "/images/image02.jpeg"
-->
...

Turning now to the topic of this thread you wll have installed the package Markdown Footnote.

https://atom.io/packages/markdown-footnote

You will find different approaches from different developers but this is a good start.

At any point in a section of the main markdown document apply the hotkeys [Ctrl + Shift + B] or use the package menu.

This inserts a footnote and the references are seen in the Preview page.

Note that link and notes are seen in same page.  You require all footnotes to be concatenated at the end of your book but we will address that later.

This should give you enough to get started.  The final stages will address pushing the previewed content into Scribus.
       
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on August 27, 2018, 03:32:38 AM
"This should give you enough to get started.  The final stages will address pushing the previewed content into Scribus."

Hoo ah... I will require a little bit of time to digest this, D-fly!
I will copy it to my desktop and chew on it.
Thank you for your time, and going a little bit above & beyond.
over and out for now.

almost forgot the question: I have Windows 7 Pro version 6.1.
jc
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on August 28, 2018, 07:34:24 PM
Hi Dragonfly,
I have installed the packages and have successfully followed your instructions as far as the section beginning:

<snip>
To avoid composing large documents you can structure your document into a tree structure in Project Manager.
test >
    merge.md    (concatenating the assets below using @import)
</snip>

... and at this point I am slowing down...
I'm going to create "merge.md" and put it in the "test" folder... (done)
the instruction " (concatenating the assets below using @import)" OK, got that.
So, I'm going to create a series of .md files and concatenate them by using @import commands in the merge.md file.

BUT first,
could you also please give me a broader overview of what is to be accomplished as though describing to a blind man how to find the bathroom?
Is it this? :
textfile1.md + textfile2.md + ... > concatenated to merge.md > ? > scribus

Will these .md files then serve as containers for all the text that I want to place in Scribus?
How much text might each .md file best contain?
How much content should the merge.md file concatenate?
How many .md files and merge1.md ... merge2.md files might I be contemplating creating and using?
What should NOT be in a .md file?
Should I point Atom's project directory to the folder I am keeping my Scribus project in and make folders there to keep the .md files in?
Or is there any reason to keep this inside the atom directory as the default has it? (just checking)
Other than specifically for this task of footnotes, what advantage is there to Markdown? Is it what you use for all text?

I feel like I am inside a black box with gloves on handling unknown objects, and I need some more orientation.
This seems like the same kind of problem I faced trying to use Lilypond for music notation - I need WYSIWYG for that, and have difficulty visualizing abstract output or even keeping track of things.
Just for the sake of overview, so that if I take my head out of the black box I know where I might be going.

Anyway, I will continue to work through (and experiment with) your instructions regardless, and will check back later.
Got a few error messages already!
thanks
jc
   
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on August 28, 2018, 09:06:21 PM
Now I have two files,
/markdown_text-files/markdown-test.md (in subdirectory)
and
merge_01.md (in parent directory to /markdown_text-files/ )

However, I am having trouble getting the merge file to refresh its content when I make changes to the source file and save them...

Update: found the refresh button in the markdown preview enhance screen, solved.
Probably ready for the next step now... knock on wood.

jc

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on August 28, 2018, 10:17:55 PM
Interim answers to your questions.

Quotecould you also please give me a broader overview of what is to be accomplished as though describing to a blind man how to find the bathroom?
...

textfile1.md + textfile2.md + ... > concatenated to merge.md > ? > scribus

That is the general idea although I have deliberately left out the final stage of pushing content into Scribus since that is work in progress.

merge.md will be the clearing house for all content to go into a book or a chapter.

You could have a merge.md for each chapter for example. Then a root merge.md which imports all your chapter merge.md files.

As explained you can build up a tree of merge.md files.  You can preview any of these merge.md files.

One tip. You can quickly inject lorem ipsum test text by typing in a blank file .. lorem .. at beginning of a line then after typing lorem hit tab key.  This is a default snippet.  Later you can add your own snippets.  Edit > Snippets ...

QuoteHow much text might each .md file best contain?

That is up to you.  You might wish to hold an entire chapter in a *.md file, or fragments of a chapter.

QuoteHow much content should the merge.md file concatenate?

You write "the" merge.md file but there can be multiple merge.md files.  The limitations are the amount of memory consumed.   And remember that you can comment out @import lines while previewing.  It is pointless previewing your entire book while you are focussed on writing a chapter. You referred in an earlier fragment of this thread to "memory issues".  So adjust the size of files to remove this memory issue.

QuoteHow many .md files and merge1.md ... merge2.md files might I be contemplating creating and using?

You have not explained how many pages will be in the final publication. But one might assume from your earlier writing .. "All of my many files (accumulated last 3 years) are made with 1.4.6" .. that this could run into many pages. Certainly others in this forum refer to hundreds of pages. This requires a a design of fragments of documents to be concatenated into end product. We have not yet considered how to include legacy *.sla files in this workflow.

As a rough rule of thumb you might hold just twenty or so @import lines in a merge.md. That is, one merge.md serving twenty imported files. But after practice you will find your own workable ratio.

QuoteWhat should NOT be in a .md file?

Nothing that I can think of, right now. You can mix text, images, svg.
As a foretaste of what will follow, you will later learn that custom commands can be added to markdown to route (push) content into Scribus document objects.

QuoteShould I point Atom's project directory to the folder I am keeping my Scribus project in and make folders there to keep the .md files in?

Avoid mixing *.md and *.sla files.

In Atom go to Packages > Project Manager Project Viewer > Edit Projects Utilities > Open database file... and in the file projects.cson project-viewer.json add a path to your Scribus project folder. Now go back to Project Manager > List Projects and click on the newly added path. You should see your Scribus repository folder in the projects directory.

Late edit: Apologies for confusion in this thread by later changing from using Project Manager to Project Viewer.

Now if in Atom you click on any of your *.sla files you will see the content as raw text (no syntax colour). This is because at this point Atom does not recognise *.sla files as *.xml files.

To correct this, view any *.sla file in Atom and go to Edit > Select Grammar and in the popup window type .. XML.

The xml syntax should now be coloured as in *,xml for any *.sla file you open.   This will take you into another world of xml syntax which we will consider later. You will see your text embedded in PAGEOBJECTS.

QuoteOther than specifically for this task of footnotes, what advantage is there to Markdown? Is it what you use for all text?

In a word - agility. And yes, it can be used for all content, freeing you from proprietary applications.

The benefits of markdown cannot be adequately summarised in this post.

Think of each of your *.md files as a parcel in the context of a post office.  Each parcel will be addressed to an address associated with postcode.  We need a routing system for such delivery of hundreds of parcels addressed to Scribus end document template(s).

Basically the markdown documents will (later) have routing commands embedded in syntax to route the parcels (document fragments) into target frames in a Scribus template or templates previously prepared in Scribus (but empty of content).

Meanwhile the markdown files can be exported using Markdown Preview Enhanced into chosen formats such as EPS or PS exactly as if you were importing (say) InDesign content into Scribus.  More on this later.

You will have no further need to go into Scribus document textframes and "import" text. Instead the content will be "pushed" from Atom into target frames.  The Scribus document styles will also be specified in markdown syntax.

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on September 07, 2018, 03:45:58 AM
Hi Dragon fly -
Last week I got heavy into learning Atom (went to youtube for tutorials) and then a lightning surge took out my computer's power supply, so I have had no computer for a week, and just got it back today. Fortunately, no data loss. I know this is up there with "the dog ate my homework".

Anyway, the Atom project is very interesting and I will take some more time next week to work on it.
I do see that Atom is a very interesting tool (with far more capacities than I am likely to use)
and I have a much better idea of how a reorganized work flow could go through it.
I do have my doubts - that is, of course, whether the required learning curve is worth the benefits, and whether it isn't going after a fly with a blunderbuss, but there do appear to be some possible benefits beyond the footnote issue, and considering the vast amount of time I have put in already on various aspects of my writing project, a little detour to learn another program is not unreasonable.

you wrote:
"You have not explained how many pages will be in the final publication. But one
might assume from your earlier writing .. "All of my many files (accumulated last 3
years) are made with 1.4.6" .. that this could run into many pages. Certainly
others in this forum refer to hundreds of pages. This requires a a design of
fragments of documents to be concatenated into end product. We have not yet
considered how to include legacy *.sla files in this workflow."

The draft I printed in April was about 250 pages with all the front & back matter, and
had eleven chapters; I have been busy pruning it to get it under 200. A chapter has
10 to 40 pages of text and graphics, all b + w only; each chapter is a separate .sla file, plus
more files for the front matter, index, notes, appendices.

As far as legacy .sla docs to be recycled into a new work flow, it probably wouldn't be any worse than
any other major revision, I could just copy the text in chunks as necessary from the PDF output from scribus.
I don't see that it's a major issue at this point but thanks for thinking of it.
The only thing really in front of my face right now is to study the input and output routine from Atom.
Apparently it exports in a lot of possible formats, so for instance I could output HTML for practice and view
it in the browser while I am just practicing the merge.md routine. I got the idea that it might even conceivably
bypass Scribus by using some other format. I am just playing with it now.

Thank you for your answers to my questions, and maybe about next Tuesday I should have another report.
In the meantime I am copying your post above and will chew on it.
j.

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 07, 2018, 06:09:20 PM
I will give a fuller reply later. But in the interim i reply to this point.

QuoteApparently it exports in a lot of possible formats, so for instance I could output HTML for practice and view it in the browser while I am just practicing the merge.md routine. I got the idea that it might even conceivably bypass Scribus by using some other format. I am just playing with it now.


I have dropped usage of package project-manager and have installed instead project-viewer.


The preview of HTML intermediate content (pre Scribus) is much enhanced if you install these packages to support your workflow.


atom-html-preview
atom-live-server
file-icons
project-viewer
tool-bar
tool-bar-markdown-writer
zentabs
tidy-markdown
markdown-table-editor
counter
autosave-onchange


Finally, I understand that Atom might be a daunting framework to learn.

It would be remiss to exclude other options for external composition of content to be piped into Scribus.
In addition to the usual editors (Word, LibreOffice) I would try ...

Scrivener
https://www.literatureandlatte.com/scrivener/overview

and a more modest editor

CherryTree
https://www.giuspen.com/cherrytree/

I use CherryTree extensively.

In your scenario you can create CherryTree nodes, subnodes, subsubnodes.

You can export all your nodes (see topbar) as PDF, HTML or as a cherrytree xml file.

So you have a full toolbox.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on September 08, 2018, 05:38:26 PM
I fear we are getting off topic in focusing on Atom instead of Scribus, and apologize to the forum generally. For me, this topic appears well worth pursuing at the moment.

At this moment I cannot grok Dragonfly's latest post, have to wait till after the weekend, as I have a workday.

To continue: It turns out that there is a Lilypond package for Atom. This offers the (albeit only a faint glimmer at the moment) possibility of bypassing my antique music notation software exported to .png and tweaked in Gimp (my production method for musical examples to date) and replacing it with Lilypond code generated in Atom and possibly using the /include or /merge routines (however that will work) to embed the examples in the doc directly. While I have seriously resisted learning Lilypond, which is a text markup language for music scoring, I am currently, as a result of this conversation, re-evaluating for the umpteenth time my entire work flow. As I did many years past successfully learn HTML sufficiently for my own purposes, and am now learning Markdown (sort of, so far), - and observing that programmers seem to not think twice about learning and using multiple programming and scripting languages, which is evident from the structure of Atom - using Lilypond is on the table again in a new context. The footnote issue has been a catalyst for this, we'll see where it goes.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 08, 2018, 09:05:20 PM
I don't consider this thread, which consider practical examples of writers' workflows, to be too off topic.
In fact practical examples do help me to think through my own workflow for applications which require (for example) mathematical expressions as in LaTeX.

My own thinking is that Scribus will always be present in the toolchain to address the final stages of publication. But it will be the last link in the toolchain before the print stage.

Scribus has openly declared some weaknesses as a mainline story editor or composer. The trick is to find the optimum boundary between external content management (Atom) and layout management (Scribus) and to create a pipe between the two.

I was unaware of Lilypond but after reading one article ...
https://rudigermeyer.com/words/diving-into-the-lilypond
I can see that it fits nicely into the Atom framework we have discussed.

So we now learn that the end document is to contain music scores.
So far. so good.

Being inquisitive by nature I explored LilyPond here.
http://lilypond.org/

QuoteLilyPond is a music engraving program, devoted to producing the highest-quality sheet music possible. It brings the aesthetics of traditionally engraved music to computer printouts.

In fact I found that lilypond 2.18.2 is available in my Ubuntu Software Centre so I simply installed that package suite using Synaptic Package Manager.

lilypond
lilypond-doc.pdf
lilypond-doc-html
lilypond-data
lilypond-doc-pdf-<different languages>

python wrappers

The full 20 yards.

Switched to learning about LilyPond ...

http://lilypond.org/doc/v2.18/Documentation/learning/index.html

Explored packages for compiling Lilypond scripts:

https://atom.io/packages/AtLilyPond      atlilypond

https://atom.io/packages/lilycompile      lilycompile

After Window:Reload I create a test file example.ly from LilyPond templates,

\version "2.18.2"

melody = \relative c' {
  \clef treble
  \key c \major
  \time 4/4

  a4 b c d
}

\score {
  \new Staff \melody
  \layout { }
  \midi { }
}


The syntax is coloured in Atom, and I can use Lilycompile to compile two files which appear in a tmp folder:
example.pdf
example.midi

I see that there is an Atom PDF View package.

https://atom.io/packages/pdf-view

apm install pdf-view

Window:Reload

And now .. I can preview the compiled Lilypond example.ly file within Atom.

It remains to feed this PDF into the document production pipeline.

Pandoc has a PDF > image filter so my next step will be to explore converting PDF to image (although Scribus can import PDF).

Another fragment I wrote in another thread explained that *.sla documents can be managed in a nosql database, since they are xml files.  But that would be required only if large collections were being pulled down into Scribus and printed and in some ways takes on Indesign et al cloud capability.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on September 11, 2018, 08:06:42 PM
Dragonfly, I am way behind on catching up in my understanding and implementation of the Atom workspace and the info in your recent advisories. This will be a work in progress.

For the record, this entire Atom-workflow proposal does nothing for my existing project, which is a complete draft requiring revision; during that revision I will have to re-number the footnotes, the reason for my original post; it would be crazy to re-format all of that material, and a re-format could also be done in OO using its footnote function, then putting text and notes back into Scribus. I will almost certainly re-number the footnotes (of the current project) one at a time instead of redoing from scratch in another program or format. Thus my original idea that Scribus could usefully offer a mere consecutive footnote numbering function, without necessary tying it dynamically to the notes themselves, still appears to be valid, even though this will not occur soon and maybe not ever.

However, at the moment, Lilypond, the music notation markup language, has become the real draw of this exploration - on its own merits, but also because of being able to integrate it with Atom, and because I have another project waiting in the wings for which the current one was intended to be, in part, a trial run of a software work flow, and which will require hundreds of new graphic examples in staff notation. According to all claims and reviews, Lilypond has superior output to wysiwyg music notation programs, at the mere cost of learning its syntax. (A small black mark is that it uses the obsolete Helmholtz pitch notation instead of the new standard, oxymoronically called Scientific Pitch Notation, but that's livable.) Then the possibility of a streamlined compilation process in which each text block is closely linked with its graphic example is very attractive, and if this can be automated so that tweaking the Lilypond code updates the final output without editing the output graphic again in Gimp (always required with the .png output from my old program) then I will save myself a lot of detail work as well as the generation and management of an extra layer of graphical source files.

But in the meantime I have a learning curve in process. I don't know how long this might take.

Thanks, over and out for now.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on September 11, 2018, 09:40:21 PM
tidy-markdown:
*****************
Failed to install tidy-markdown because Git was not found.
The tidy-markdown package has module dependencies that cannot be installed without Git.
You need to install Git and add it to your path environment variable in order to install this package.
You can install Git by downloading, installing, and launching GitHub for Windows: https://windows.github.com
Run apm -v after installing Git to see what version has been detected.
***************

I have installed GitHub and it has written itself into the PATH, but I still get this error when installing tidy-markdown.
I don't need tidy-markdown yet so this is not yet an obstacle.

As far as Scrivener and Cherry Tree, I will put those suggestions aside for now; I have enough on my plate.

Now the good news: I have installed Lilypond, created a test.ly file from inside Atom, and compiled it to a PDF
using lilypond-compile from within Atom, and using Atom package pdf-view, can see the file inside Atom. This is
all a major step forward. (This required that I put Lilypond in the PATH myself and restart.)

The routine which I now wish to master is to create a file caption.md with some text and a footnote in it, along with a musical example example.ly, merge these two files and push them to Scribus while stripping out the footnote to another file which will eventually go into the file footnotes-merge.md and be pushed to another Scribus file.

However, I don't know how to do all this yet. So, for the moment, I am going to work a little on learning Lilypond.
jackcat
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 11, 2018, 11:14:57 PM
I understand that learning a new framework is a significant step.  I will only add that terms such as Helmholtz pitch notation  and Scientific Pitch Notation are double Dutch to me. My last efforts at writing music on a computer was very early in my career when, supporting a hi-fi expert, I wrote such a program. In those days the compiler was installed from paper tape and a crude notation language generated bitstream to drive a prototype digital to analogue converter to make crude musical tones.

Now many years later I am learning about LilyPond and also MusicXML.

I find that scores have much in common with mathematical expressions written in LaTeX notation.

There is also the linking of mathematics and music I have read.

http://www.ams.org/publicoutreach/math-and-music (http://www.ams.org/publicoutreach/math-and-music)

By coincidence your music project challenge has proven to be an excellent example to shakedown the Atom framework I have drawn together.

Considering your task at hand I would suggest considering three parallel workflows.

First, I suggest carry on using Scribus as you have in the past.

Second, I suggest having a workflow to learn more about Atom and how it can be used to compile LilyPond scripts to create assets.  Keep Scribus out of this experiment for now.  You can always manually import into Scribus assets created by this workflow.

Third, in the longer term when I have finished my work developing Atom to Scribus pipe you can try that.

Returning to the second option, the Atom framework, I have tried a number of packages to optimise the workflow and have homed in on those required for LilyPond. I have also learned how to easily convert LilyPond scripts to musicxml format.

There are converters which convert document formats to other formats. See Pandoc.
There are converters which convert file types to others.
Similarly there are converters for converting music notations.

Here is one addressing the problem you posed.

https://futuremillennium.github.io/Helmholtz-Pitch-Notation-Converter/

I will go back through my earlier writing and draw a red line through packages which have been replaced by better packages, after testing.

It is very easy to inspect the inventory of Atom packages already installed. Just run the command:

apm list

Some words of immediate advice regarding Atom usage:

Install the theme atom-material-ui
install the package project-viewer   (not project-manager)
install the package svg-viewer svg-preview

Now assuming that you have installed the packages AtLilyPond and lilycompile
navigate to lilycompile package settings and change the File Type: from default PDF to SVG.

It is then easier to embed an SVG file into markdown using the @import statement.
So in short switch from PDF to SVG output from lilycompile.

Just to give you some encouragement, attached is a short clip showing merge of text and music score.

And there is no need to play with git just yet. Stay local.

[attachment deleted by admin]
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 11, 2018, 11:28:39 PM
Postscript

I forgot to write that there is another way of previewing SVG produced by lilycompile.
In the /tmp folder which is created (containing score.pdf or score.svg) create a blank file merge.md.

In this file simply write:

@import "score.svg"

and you can preview the compiled score compiled as SVG (not PDF). Note that you cannot easily import PDF in the same way so this is why I recommend lilycompile settings File Type: be set to SVG.
Do focus on studying project-viewer Features since you can create multiple "virtual projects". For example I downloaded the LilyPond Snippets Respository files and placed these snippets in a local folder:

~/Atom-repo/music/lsr/

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on September 12, 2018, 05:08:26 AM
"Install the theme atom-material-ui"
I have done this and been through its settings. Only I cannot find a setting for the font color, which is almost too pale to read.

Now, in Atom, there is a brief message that flashes up (and then disappears) when I open Atom, saying something about a database. If I click on this I get a flag that says: Local database already found! Are you sure you want to lose it?
Now, I don't know anything about a local database... but I hesitate to click through such a warning message until I know what is going on.

Project viewer is installed. I have not yet done anything with it - it says "no projects". What is the first thing I should do with it?
I did not find svg-viewer. I installed svg-preview, which works.
Thank you for telling me how to set the switch for lilypond-compile to make svg.
I used lilypond-compile to generate an svg and viewed it with svg-preview.
Lilypond's svg files have an added benefit I had not anticipated: you can open them with Inkscape and move every object around to suit, thus it offers a great deal of tweakability even for newbies, although this is an extra step which should probably be unnecessary because the Lilypond language is supposed to be very precise although with many complexities. However, it offers a welcome alternative to trying to tweak the code to get some precise result, in a pinch (which I can certainly imagine), and it beats cutting and pasting in Gimp.

Given your example and instruction so far, I am pretty sure that I will have no trouble generating short documents containing md text and music notation.

Re: Helmholtz vs SPN pitch notation - this is not an issue. I was just expressing myself. Helmholtz notation is harder to read when there are 3 or 4 diacritical marks as in c'''' . Middle C = SPN C4 = Helmholtz c', but Lilypond uses the numbers 1-2-4-8 as note-attributes for time-duration values instead. The octaves of both pitch notation systems begin with C at the bottom and B at the top, instead of starting with A as might be thought logical, and have a direct correspondence, not like lunar & solar calendars. No conversion table is necessary because they are both easy to memorize, SPN being a little more obvious.

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 12, 2018, 12:04:41 PM
Quote"Install the theme atom-material-ui"
I have done this and been through its settings. Only I cannot find a setting for the font color, which is almost too pale to read.

I agree that the default font colour is perhaps too pale. 

Now go to Preferences > Settings > Theme > Atom Material >  and look at Syntax Theme.  It may be that your setting is "One Dark" (as is mine) which does indeed render overly pale text. Experiment with other Syntax Themes in the list.

I remember experimenting and adding the packages .. monokai-seti and seti-ui

apm install monokai-seti
apm install seti-ui

and set Syntax Theme to Monokai Seti.

Of course you can try different settings and there is a link at top of Theme Settings panel which reads .. "You can also style Atom by editing your stylesheet".


QuoteLocal database already found! Are you sure you want to lose it?

I have not seen that message. To search I simply used this google search pattern ... (learn about Advanced google search syntax, it can be useful).

Atom NEAR "Local database already found! Are you sure you want to lose it?"

This thread popped up.
https://discuss.atom.io/t/local-database-corrupted/51495 (https://discuss.atom.io/t/local-database-corrupted/51495)

You can try temporarily launching Atom in safe mode which disables all installed packages.

atom --safe

Check if the message does not appear in "Atom safe mode". If so then it is an installed Community Package generating it.

However the discussion thread above points to package project-viewer which I suggested that you install.

There is a local database within project-viewer and the message might refer to that if it is empty or has not been setup to configure projects.

Packages > Project Viewer > Utilities > open database File

This opens ~/.atom/project-viewer.json which contains any projects setup previously.

Here is further discussion on this warning message.

https://github.com/jccguimaraes/atom-project-viewer/issues/115 (https://github.com/jccguimaraes/atom-project-viewer/issues/115)

I would try just toggling the Project Viewer panel on and off to clear the message.


QuoteProject viewer is installed. I have not yet done anything with it - it says "no projects". What is the first thing I should do with it?

i do urge you to persevere with this package. It will save a lot of time in navigating through many folders and files, and goes beyond the navigation features in Tree View on the left.

Project Viewer will be valuable later in navigating through various chapters in a project.

Basically, it allows you to define "virtual projects" which on clicking automatically populate an index in the left Project panel (Tree View).

To get started launch the Project Viewer panel from Packages > Project Viewer > Toggle Panel.

There are several methods available to define "virtual projects".

In the Panel you can right click to see:

Create new group...
Create new project...

Start by having a centralised root repository for all your project files although they will be in different sub-directories.

i create ~/Atom-repo/ as my root repository.

Now using your Windows File Manager create as many sub-directories as you wish to manage your projects which will grow in time.

Let us create ~/Atom-repo/lilypond/ .. as a "physical project"
(you will have to use Windows path notation, the above being Linux path)

Now go to Project Viewer Panel, right click, Create project...

The PV editor will appear.

Under "Name" .. type the project name (which need not be the name of your target folder).
Let us name the virtual project as "music".

Note that the create button is at the top of PV editor and after typing configuration settings you will  create a project to be seen in PV Panel.

After defining project name, scroll down to Paths.
Add project folder(s) - [ ? ] each path is a project?

We will keep it simple and simply click on Add project folder(s)
and type in the path to the "real project" folder
~/Atom-repo/lilypond

Now click on Create at top of form.
You will see "music" appearing in the Project Viewer Panel to the right.

In summary we can have a "virtual project" named "music" launching "~/Atom-repo/lilypond" in the left side Project Panel. Or you can name the project "lilypond" if you prefer to match virtual and physical project names.

There are advanced features such as putting projects into groups, or nesting groups. but stay with just projects for now.

Another project might be "MyBook" pointing to your chapters.  And so on.

QuoteLilypond's svg files have an added benefit I had not anticipated: you can open them with Inkscape and move every object around to suit, thus it offers a great deal of tweakability even for newbies, although this is an extra step which should probably be unnecessary because the Lilypond language is supposed to be very precise although with many complexities.

I did consider mentioning Inkscape as SVG editor in the toolchain but thought that this might be too much to take in.

When lilycompile creates an SVG file it places a footer at bottom of compiled page which creates quite a bit of whitespace when embedding the image into markdown. I used Inkscape to move the footer object then cropped the image. One point to watch when cropping is to always use the same width of cropping container, otherwise different scaling might creep in.

Quotethe Lilypond language is supposed to be very precise although with many complexities.

The LilyPond application does indeed have a rich command line vocabulary. One should remember that all of the operations we are discussing can be executed through command line and running shell scripts without need for Atom lilycompile which simply calls LilyPond through command line. But Atom allows viewing and editing of content.


Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on September 13, 2018, 06:02:08 AM
The font color thing in Atom I have worked out - just a brain-dead moment.

Lilypond's tag line at the end of the file is annoying and clearly undesirable, but I think that there must be a switch to turn it off instead of having to crop every file. There are switches to suppress several other automatic formatting features built into the code, such as turning off the automatic time signature.

I have high hopes for being able to output examples in staff notation which are all of a standard readable size and to avoid the scaling issues I have had with high-res .png files which are very hard to scale consistently inside Scribus. (It is annoying that Scribus's grid is hidden behind my .png images, if it were possible to make it appear on top of them it would make consistent scaling easier.)

For Lilypond, working inside Atom seems to be a Very Good Thing: today I had an .ly file in one tab, the .svg code showing up in another tab, the svg rendered graphically in another tab, and error messages popping up from lilypond-compile as I typed, all in real time. I don't think I will need all this feedback but it is very useful to see everything that's going on at this stage.

Now, I think it will probably take me a year to get really up to speed with Lilypond, and by that time perhaps you (dragonfly) will have your Markdown-to-Scribus pipeline in place. (I see that such a project was proposed for Scribus in 2013 and is dead in the water.)

Markdown looks very easy. I see that I can use Pandoc to convert to HTML and import to Scribus - I have not done this yet, but I have some experimentation to do before I ask more questions about that, and I haven't acted on all the info that I already have.

Atom itself is more difficult to get simply because it has a bewildering number of capacities but there are many tutorials on youtube and I don't think that I will have to bug you about picayune details any more. I was interested to find that I can run "apm install *package*" from the command line without Atom being open. I have a shortcut to the old DOS command line window because I still use DOS now and then to sort text files.

Now I am going to look at Project Viewer per your last post. Thank you for pointing me to discussions about the database. I am inclined to go ahead and convert the database that exists, because I can't think of anything important to me that is likely to be in it.
thanks
jack
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 14, 2018, 11:29:25 AM
I will try to draw a close to this thread which could go on for some time since the dimension of music notation has been added. However, there are some loose ends to tie up before returning to my mainline interest - to explore hooking up Scribus to an external toolchain.

QuoteLilypond's tag line at the end of the file is annoying and clearly undesirable, but I think that there must be a switch to turn it off instead of having to crop every file.

I have read somewhere that this can be removed by registering as a user with LilyPond.

I would delete this footer actually seen at the bottom of the SVG file.  I now see that there is no need to crop it in Inkscape other than removing white space in the produced page. But even that cropping can be done at SVG file level.

You can also tweak SVG content and see the changes in the SVG viewer panel.

This video I followed shows "slur shapes" being tweaked in Denemo.

https://vimeo.com/64408182 (https://vimeo.com/64408182)

Inkscape can also be used in command line mode to tweak objects and I will explore this later. (See Process Pallette below)

One note of caution. Such tweaks in the end images do not reflect back into the original markdown source and it would be better to learn to tweak at markdown level, and not at SVG level.  This will guarantee the integrity of your workflow should you need to reverse any steps and later recompile your markdown.

QuoteNow, I think it will probably take me a year to get really up to speed with Lilypond, and by that time perhaps you will have your Markdown-to-Scribus pipeline in place.

That is a reasonable timeframe for your book project. I hope to develop the Atom-Scribus pipeline rather sooner for my own purposes. I will release that after testing.  This exercise in music notation does help as a test data set.

QuoteAtom itself is more difficult to get simply because it has a bewildering number of capacities

That is true and the trick is to vet the library of packages to see what mix might apply to each user's workflow.

I realise that there are different classes of Scribus user following this forum. Some are authors only who do not wish to dabble in programming and some are authors and developers confident to expand their toolbox. Perhaps when posting questions the original poster (OP) should be asked to give a profile to avoid receiving deep technical replies.

The DOS command apm list is useful. Explore the "featured" packages in Atom.

In your developing project there will be many points where you put an action or tweak "on hold" for another day. I found the package TODO to be very useful for the purpose of coming back to reminders embedded in each project file.

Basically you can drop a trigger phrase inside any markdown file and this package will hunt through your files to locate all // TODO statements. There are many found in LilyPond snippets repository, which TODO picks up.

Here is an example:

// TODO: must tweak this score before publishing


QuoteI was interested to find that I can run "apm install *package*" from the command line without Atom being open.

apm is alias for Atom Package Manager which manages all Atom assets through DOS command line.

https://github.com/atom/apm (https://github.com/atom/apm)

If you now run the command apm --help you will see a list of other options.

for example run apm help <command> to explore any other option before using.

apm help featured


QuoteI am inclined to go ahead and convert the database that exists, because I can't think of anything important to me that is likely to be in it.

Yes, I agree and think that this message will clear up after you start using project-viewer.

But if you are concerned about corrupting your future project work you should start thinking about a project backup strategy so that you can fall back to earlier project states, including Atom configuration files which might be edited over time.

This explains backing up .atom.
https://discuss.atom.io/t/how-to-backup-settings-packages-and-every-thing/42887 (https://discuss.atom.io/t/how-to-backup-settings-packages-and-every-thing/42887)

But you will also need to backup your ~/Atom-repo/ contents if you have centralised your project files there as suggested earlier.

There are advanced backup tools which only backup intermediate changes.

I am just starting to learn about Atom backup tools.  If the project is important perhaps creating a private git account or Dropbox account might be prudent and then syncing your local project file with the remote content.

https://discuss.atom.io/t/how-to-backup-settings-packages-and-every-thing/42887 (https://discuss.atom.io/t/how-to-backup-settings-packages-and-every-thing/42887)

QuoteI have a shortcut to the old DOS command line window

That requires jumping out of Atom world.  There is another useful Atom Community Package

terminal-tab

which launches a terminal inside Atom (location can be set in package Settings).
It is always a good idea to become familiar with these Settings after installing any new package.

terminal-tab opens by default below the editor panel.

===========================================

Process Palette Package

Edit: I came back to read this section again and decided I needed to edit it since it is tricky package to use for the first time user.

While terminal-tab is useful for one off commands, a much more comprehensive package for building a library of custom commands is process-palette.

https://atom.io/packages/process-palette (https://atom.io/packages/process-palette)

This package allows a custom library of shell (or DOS) commands to be built up by the user.  This will come into use when we learn later that there is more to lilypond than just the basic package lilypond:compile. Indeed, I was surprised that the Atom package lilycompile has not (yet) been extended to take full advantage of the LilyPond commands available.

The lilycompile package README.md does explain that it is a single command package.

"Comes with one configurable command, lilycompile:compile (ctrl-alt-l), which only triggers in .ly files."

If you inspect lilycompile Settings > Binary there is only one command available.
Default: lilypond

I searched my Linux filesystem looking for the pattern bin/lily
and I found these (all command line executables in bin folder):

/usr/bin/lilymidi
/usr/bin/lilypond
/usr/bin/lilypond-book
/usr/bin/lilypond-invoke-editor
/usr/bin/lilysong

Paths for Windows will differ.

Now we already know that lilypond converts *.ly files to *.svg (or pdf, jpg, ps).
This is the single command used by lilycompile package.

But I have learned from browsing the LilyPond site that lilypond-book converts *.lytex files (not *.ly files) into merged text and scores as a "lilybook" as explained here.

http://lilypond.org/doc/v2.19/Documentation/usage/an-example-of-a-musicological-document (http://lilypond.org/doc/v2.19/Documentation/usage/an-example-of-a-musicological-document)

I do not see that it is an easy process to extend the lilycompile package to leverage lilypond-book. Instead I decided to use package Process Palette to exploit the full scope of LilyPond commands.

Running this example ...

http://lilypond.org/doc/v2.19/Documentation/usage/an-example-of-a-musicological-document (http://lilypond.org/doc/v2.19/Documentation/usage/an-example-of-a-musicological-document)

I read that the command to run is ...

lilypond-book --output=out --pdf lilybook.lytex

In command terminal this should compile lilybook.lytex as pdf.

However in Atom the command must be changed to run the file in focus in editor which is defined by the Atom variable {filePath}

lilypond-book --output=out --pdf {filePath}

Navigate to Packages > Process Palette > Settings

We read that we must edit process-palette.json to create a library of custom commands.

Note: In the lilybookexample there is a line referring to screech-and-boink.ly

Comment out this line with a % at start of line
to avoid errors in compilation.


Now we require to add a custom command to compile the file lilybook.lytex

Navigate to Edit > Configuration > Settings > Packages > Process Viewer > Toggle.
A Process Palette window will appear underneath the editor centre window.
Click on "Help" button at top (resembles a cog wheel).

There are two options seen:


Clicking on [Doit button] places a process-palette.json in either global location or local project location.

After loading a configuration file the command Process Palette: Reload Configuration is run to load it.

The list of Process Palette commands can be seen by launching Command Palette [Ctrl+Shift+P].

Or you can go to Packages > Command Palette > Toggle .. and type Process Palette.

...

This lists all the available Process Palette commands.

Choose Process Palette: Edit Configuration

...

The Graphical Editor to add commands might be tricky to spot at first usage.

When the Process Palette panel appears there is a Global title with a list of commands underneath.

In any command definition starting from the left is

a run button
an edit button
and then the name given to the command.

Click on the edit button and the editor appears above with title Global Commands.

There is a list of created custom commands (there will be at least one example on first usage of package).

Click on "add" and a GUI pops up for the custom command creation.

General
Namespace: process-palette
Action Name:   we might specify here ... lilybook-compile-pdf
Shell Command:  we write here the command to be run
Working Directory:   we write here the working directory
Menu: optionally the command might be added to Menus

The completed custom command will appear under Global Commands.

This is the basic first test command inserted to experiment with lilybook (we will learn later that this command needs to be expanded to tidy up surplus files created in /out folder during compilation).

lilypond-book --output=out --pdf {filePath}

Now we can create a lilybook.lytex file, focus on the file and with the Process Palette window viewed underneath select command: Process Palette: Lilybook Compile Pdf
and run process.

The command output will show as in a terminal.

To go back to Process Palette panel click on the button with three horizontal bars at top

The compiled output files are placed in an /out directory within the project root folder.

Reading the guide here ...

http://lilypond.org/doc/v2.19/Documentation/usage/an-example-of-a-musicological-document

under Processing, the command
pdflatex lilybook
has to be added to the original command to clear out unwanted files.

I ran that command on the /out folder and the outcome is lilybook.pdf.

Click on the created pdf file and we see them in pdf-view.
We can also delete the entire /out folder to purge all experiments and re-compile to see it being reinserted.

This is what is created in configuration file:-

    {
      "namespace": "process-palette",
      "action": "lilybook-compile-pdf",
      "command": "lilypond-book --output=out --pdf {filePath}",
      "arguments": [],
      "cwd": null,
      "inputDialogs": [],
      "env": {},
      "keystroke": null,
      "stream": true,
      "outputTarget": "panel",
      "outputBufferSize": 80000,
      "maxCompleted": 3,
      "autoShowOutput": true,
      "autoHideOutput": false,
      "scrollLockEnabled": false,
      "singular": false,
      "promptToSave": true,
      "saveOption": "none",
      "patterns": [
        "default"
      ],
     


The summary is that we now have a powerful package to extend Atom by adding custom commands. This will come in handy for many command line jobs such as running lilypond, lilypond-book, and pandoc commands.

===========================================

Concluding:

There is a continent of Packages to explore in Atom framework and for a newcomer (particularly a non-developer) early returns should not be expected.

But as you wrote here .. http://forums.scribus.net/index.php/topic,3021.0.html (http://forums.scribus.net/index.php/topic,3021.0.html)

"Slow, maybe, but you know, water wears away the stone".

Atom is a diamond tipped tool to sculpt the stone.

Good luck with your projects. The test case has proven to be interesting.


[attachment deleted by admin]
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on September 14, 2018, 08:10:51 PM
That last post will take me some time to digest.

Here I offer some comments:

#### The Paradigm Change of our time: Print vs HTML & Digitalization in general

Dragonfly's proposal for a pipeline from markdown language to Scribus raises the issue of the current paradigm change from paper to digital media, which every Scribus user must be aware of, I should think.

For 500 years paper publishing was lucrative. Paper sheet music sales were an income stream for musicians from 1500 on, reached a peak in the late 19th century, crashed with the advent of recording technology and have been nearly destroyed by the internet and at the very least must be marketed on the web.

By digitalization the value of a musical recording has been recently devalued a hundred-fold in the shift from CDs to MP3 download. A few years ago an independent musician could sell a self-produced CD for a 500% markup over the raw material, now we _pay_ for entry to the Spotify market where a listener download pays an infinitesimal trickle-down percentage.

A legacy book which I am studying is in the digital commons and available free, whereas the modern English translation, out of print but not out of copyright, is up for $1200 USD on Amazon.

An author who goes to the trouble of creating a print book using Scribus faces (1) being lost in the competition, (2) the likelihood that someone will scan it and post it on Scribd.com available almost free, (3) the fact that the same material could be formatted in HTML and published on the net for free, or sold digitally.

So, a person such as myself, thinking that I might sum up my life's work with a print volume fit to sit on a bookshelf alongside the classics (ha! right), must accept that this is a vanity project.

The open source model which is so apparent behind the proposed .md to Scribus workflow suggests that the end product might as well be free and open source, and published on the web, and so why go to print or even to printable format at all (i.e. Scribus) in my case? Markdown is already a pipeline to the web, it's primary designed purpose, and to create from it a secondary pipeline to Scribus also runs up against the McLuhan "the Medium is the Message" factor, which I can see in front of me as I type this in the Atom editor, which is alien to my thought process of the last 40 years - it offers, even full-screen, only a narrow window into the work in hand, and the Markdown Preview flows into the size of its tab, showing only content and not format.

Because "the Medium is the Message", I think of my print project in terms of a series of two-page spreads, offering a series of 17" by 11" workspaces which must each communicate as complete an idea as possible, ideally without a page turn in mid-thought, so as not to require a reader studying the material to flip pages back and forth between graphical example and explanation, being open on a music stand in front of a person whose hands are busy playing an instrument. This is different from a novel, which can be poured into Scribus as into a container, and also different from the new model of the foot-pedal-controlled scrolling PDF reader; my more traditional concept is dependent on graphical layout. At one time I contemplated doing it as a series of Illustrator files (now it would be Inkscape as I have migrated). I believe that this is also a factor for the Scribus User who recently posted about a projected animal encyclopedia.

For such a use, the proposed pipeline will need to include a quick and painless zoomable preview-as-print function, otherwise the user will be essentially working in the dark. I see that Atom can do this fairly effectively for Lilypond already, and that therefore this capacity is not out of the question. Even in Scribus, however, I must frequently export to PDF to get a clearer view, and even that is not sufficient, because the only real test, allowing a truly critical overview, is a draft print on paper, because on-screen content does not reveal many errors and my eyes play tricks, seeing what I think I have written or drawn and gliding over many errors. Even this file did not reveal several errors until I exported it to HTML and opened it in the browser.

Anyway, as I sit here contemplating, and experimenting with, the components of the proposed Atom > Markdown > Lilypond > HTML > Scribus workflow, there are two issues that arise, one practical and one more philosophical:

1. Practically, the difficulty of creating content in one medium (Atom etc) and then pouring it into a container which is likely to prove to be a procrustean bed for that content (Scribus as a container designed for the reception and formatting of lineal content such as a novel, to put the worst face on it). That is, the pipeline appears to require a certain fluidity and homogeneity of the content in order to flow; insufficiently-fluid content is likely to be sliced, diced and homogenized.

2. Philosophically, the questioning of the entire model of "print" and the use of Scribus, vs. surrendering to the tenor of the time and publishing either in HTML, or e-reader viewable PDF, thereby relinquishing the idea of selling paper books at all.

I offer no conclusions. I am going to spend some reasonable amount of time experimenting with my re-designed work flow, and consider it worth the time; as I said, Lilypond alone is a fairly long-term project. Atom is a very interesting tool, I will also require some time with it to really evaluate it.
thanks
jack_cat
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 14, 2018, 09:33:01 PM
Certainly adds more food for thought. I can see that "music flow" (reading music sheets while playing music score) adds another dimension to the design of the workflow. I am neither a musician or composer.

Perhaps you could "emulate" the display of music sheets by using presentation techniques.

Within Markdown Preview Enhanced there is a documented Pandoc option to specify in markdown to create a presentation (look at reveal.js and beamer) instead of printed PDF.  You simply add frontmatter (YAML) to produce a two page presentation of music sheets which can "screen flip".

https://github.com/shd101wyy/markdown-preview-enhanced/blob/master/docs/presentation-intro.md (https://github.com/shd101wyy/markdown-preview-enhanced/blob/master/docs/presentation-intro.md)

Thus, I have a vague idea that you could emulate music sheets being viewed and flipped over, while the musician continues to play the score.

The workflows in reading a music book and playing music from a digital presentation present different challenges.

Some interesting links you might follow up:-

https://www.4barsrest.com/articles/2013/1413.asp (https://www.4barsrest.com/articles/2013/1413.asp)

https://www.timbercroftpublishing.com/ (https://www.timbercroftpublishing.com/)

And to avoid your works being ripped off study Digital Rights Management.  There is software available (actually only in Windows) which stamps your end product and embeds digital signatures.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 15, 2018, 11:30:32 AM
Here is another tool .. Zotero .. to bear in mind in future for adding/importing citations, bibliographies (e.g. composers) into your markdown documents.  My recommendation is to download the "standalone" Zotero version plus the Zotero connector extension which is installed into a browser. Then when you read a music item or composer biography you can click on the save to zotero icon in browser bar to add item to your collection.

https://forums.zotero.org/search/?Search=music (https://forums.zotero.org/search/?Search=music)

Open a free account and create your own collection of music research and citations can be added into markdown.

Your Zotero collection can be private or public. You keep a local collection and sync it with your account on Zotero.

I will be adding this option to the Atom framework.

This takes you into the world of digital libraries and how major libraries categorise music.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 17, 2018, 12:59:39 PM
QuoteI think of my print project in terms of a series of two-page spreads, offering a series of 17" by 11" workspaces which must each communicate as complete an idea as possible, ideally without a page turn in mid-thought, so as not to require a reader studying the material to flip pages back and forth between graphical example and explanation

I am writing a separate tutorial as I again walk through the installation of an Atom framework from scratch, recognising that there will be different types of user.

One tip I will pass on here.

You will benefit from setting up "virtual desktops" on your PC. In Ubuntu I can create a grid of virtual desktops and launch multiple instances of Atom windows. Each window instance can then be moved to a "virtual desktop" Thus, you can be editing and testing markdown in one virtual desktop and previewing your rendered music score in other virtual desktops.

You might emulate your envisaged 17" x 11" music sheets across two dedicated virtual desktops.

Summarising (using virtual desktops or workspaces instead of tabs which can become cluttered in a small screen):

virtual desktop 1 - writing markdown, previewing notes, pages, chapters (Markdown Preview Enhanced)
virtual desktop 2 - previewing LilyPond compiled SVG
virtual desktop 3 - previewing left hand page music score (8.5" x 11" ?)
virtual desktop 4 - previewing right hand page music score (8.5" x 11" ?)
... and other desktops/workspaces as required

In Ubuntu my workspace switcher is setup to appear in bottom Docky status bar.

Further tweaking this idea ...

After further experimenting with Atom I see that any Atom window can be toggled to full screen display via View > Toggle Full Screen (F11).
This allows the two (or more) music score workspaces to be navigated without the clutter of menu bars at top of screen.  A separate command could load different music score pairs into the two music score workspaces.
page1+2, page3+4, page5+6, page7+8 .. and so on to end of composition.

Navigate workspaces grid by [Ctrl+Alt+Arrow Right, Left, Up, Down].
And to view the thumbnail workspace grid use [Superkey+S].

All that is needed now is to hook up a hands free USB footswitch to navigate through these workspaces - while playing the music composition.

End of brain storm.


Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on September 18, 2018, 02:31:39 PM
We see a fertile mind at work. I don't know how long it will take me to catch up.
I will plug along in Dragonfly's dust trail. Hasta pronto.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 22, 2018, 10:39:44 PM
I have been studying how to build the final leg of the pipeline from Atom to Scribus.

All roads lead to Rome.

But I read here from post#3 ..

QuoteAll of my many files (accumulated last 3 years) are made with 1.4.6, and I understand that 1.5 uses a new file format not backwardly-compatible; this and the report that the footnote functions are still incomplete has discouraged me from making an experiment.

From my reading through the forum there are many users still using the stable version of Scribus 1.4.x.

I have been experimenting on Scribus-trunk 1.5.5 (daily build) which has the ability to exploit python scripting to move pre-processed content from Atom (or LibreOffice) into Scribus.

However Scripter is not available on early version 1.4.x.

This leads me to consider developing two pipeline routes for different users.

(a) Atom accessing Scribus through methods in Atom which leverage the Scribus XML (.sla) format. This approach should work for both 1.4.x (stable) and 1.5.x (development).

(b) Atom driving Scribus through command line and leveraging Scripter.
This will not work with 1.4x but I can see should work with 1.5.x.

I'm not sure about the relative populations of 1.4.x users vs 1.5.x users.

My personal preference is the XML route which should support both 1.4.x and 1.5.x including legacy documents.

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 24, 2018, 12:01:25 PM
@jack_cat
How are you faring? Need any tips on usage?
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on September 27, 2018, 12:43:15 AM
Quote from: dragonfly on September 24, 2018, 12:01:25 PM
@jack_cat
How are you faring? Need any tips on usage?

thanks for asking...
I have focused lately on learning Lilypond, which I am doing from within Atom using Lily-compile after almost every keystroke. Mostly, learning Lilypond is a matter of finding code snippets online, plugging them into the file and seeing if they work, which usually they don't the first time, but with patience I have solved everything so far.

An issue that has arisen just now has to do with the export routine via either .svg or .png from Lilypond for insertion into Scribus (bypassing markdown etc for the moment ).

I just did a test because I wanted to compare Lilypond output directly to MusEdit output (a cheap and useful workhorse I have had since 1997), so I re-created one of my MusEdit examples in Lilypond and put them side by side in a test.sla file and exported to .pdf to look at it in Foxit reader. Not to knock MusEdit which has many very useful features for an inexpensive and now antiquated program, but Lilypond's output is definitely up to Schirmer edition engraving standards and looks much classier, not to say, ahem, more professional.

I had no luck trying to use File > Import > Get Vector File (or whatever it is) in Scribus, couldn't make that routine work, nohow, at least so far... I had hoped Scribus would import the .svg and just deal with it automatically, but there is something I don't know.

so I changed from .svg to .png to try that (changing Lily-compiles output setting). I placed Lilypond and MusEdit .png files with very nearly the same content side by side on a two page spread in Scribus to compare. Visually in .pdf in the reader, without going to print, the result is excellent, but:

Lilypond's .png is lower res at only 100 dpi than the 144 dpi that Scribus wants. It looks OK in .pdf, but it probably will not look so good in print, and I have to override Scribus's error message on the pdf export. MusEdit exports, optionally, hi-res .png files, a very nice feature, they are far higher res than necessary but they look sharp in print. So, I have to find out how to make Lilypond generate hi-res .png images, and then to find out - ha, this is a long shot for python-ignoramus me - whether Lily-compile can be tweaked to have this option. Do you have a comment on that possibility? This is premature, because I have interrupted the search for a Lilypond hi-res .png feature to check in here and take a few minutes to answer your inquiry.

As far as Atom goes, I am just getting used to using it. I have updated my web site editing HTML with it, no problem, although there is no obvious advantage over my other html editor, as matters stand. I have not done much with Markdown - it looks pretty straightforward and transparent as far as I can tell, and I will play with it on small test projects as they come up.

So that's the report, as far as it goes, inconclusive for the moment, because I still have a long learning curve for Lilypond ahead. I have left the revision of my older project draft with the footnotes, for which I began this thread, on ice for now, will get back to it when I'm ready. I have no shortage of projects on hand, so right now I am putting in a couple of hours on Lilypond every day or two, and am keeping busy.

I post a screenshot of my test file output.

ps: this from Lilypond docs, command line options:

____

--png

    Generate pictures of each page, in PNG format. This implies '--ps'. The resolution in DPI of the image may be set with

        -dresolution=110


____

do I dare open up the python file for lily-compile and find and tweak this? Any advice?

thanks
jack_cat



[attachment deleted by admin]
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on September 27, 2018, 05:48:19 AM
Ok, I found the place to put "custom arguments" into Lily-compile.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: a.l.e on September 27, 2018, 09:20:53 AM
can you please upload the svg to the bug tracker and see if the team can find what's wrong with it?

https://bugs.scribus.net

there might be a problem on the lillypond side... or on the scribus side...
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 27, 2018, 03:14:46 PM
That looks like good progress to me.
I can confirm that rendering the SVG output from lilypond in Scribus frame hits  problems. When I have time I will look into the internal structure. But as @i.l.e suggests send a sample to the Scribus developers.

Meanwhile you have to focus on PNG.

It is a wise move to park using other features until you grasp the lilypond command line options.

I suggest that you track two parallel forums:
(a) this Scribus forum
(b) Lilypond forum

Looking at latter forum ..

http://lilypond.1069038.n5.nabble.com/Horizontalized-scores-td158972.html#a159389 (http://lilypond.1069038.n5.nabble.com/Horizontalized-scores-td158972.html#a159389)

this led me here ..

http://www.notezilla.io/ (http://www.notezilla.io/)

http://www.notezilla.io/p/beethoven/fur-elise (http://www.notezilla.io/p/beethoven/fur-elise)

Might give you some ideas for monetising your works (re: your earlier observations on earning returns).

I tried this command ..

lilypond --png -danti-alias-factor=10 -dresolution=300 example.ly

I think that you will need to install ImageMagick.

The output looks crisp (note use of anti-alias and increased resolution).
I made the mistake of missing out the "-" before d. Then it worked when I corrected arguments.

If you want to build up a library of different commands to try then I suggest that you install the scripts package in Atom.

Then a library of frequently used commands can be created as one liner scripts and run by Scripts.  This might be easier than frequently modifying the custom arguments field in lily-compile.

Here is an example .. lilypond-png.sh

#!/bin/bash

filename="/home/user/Atom-repo/music-experiment/example.ly"

lilypond --png -danti-alias-factor=10 -dresolution=300 $filename


Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 27, 2018, 09:11:03 PM
Source of further user tips:

Go to lilypond archives mailing list and in there search "Scribus" .. and "SVG"

http://lilypond.1069038.n5.nabble.com/template/NamlServlet.jtp?macro=search_page&node=2&query=scribus&i=12 (http://lilypond.1069038.n5.nabble.com/template/NamlServlet.jtp?macro=search_page&node=2&query=scribus&i=12)
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on September 29, 2018, 10:43:42 AM
Re: Scribus not rendering correctly the SVG output from LilyPond compilation.

I have an idea that the Scribus SVG rendering engine might need to import LilyPond fonts?
I will explore that theory at some point (but this idea is parked for now).
Meanwhile other exported image formats work nicely.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on October 11, 2018, 05:40:29 AM
Quote from: a.l.e on September 27, 2018, 09:20:53 AM
can you please upload the svg to the bug tracker and see if the team can find what's wrong with it?

https://bugs.scribus.net

there might be a problem on the lillypond side... or on the scribus side...

Quote from: dragonfly on September 27, 2018, 03:14:46 PM
I can confirm that rendering the SVG output from lilypond in Scribus frame hits problems.

I was not sure that the error was not mine in some way. Dragonfly confirms some kind of error.
It is a little difficult to describe; Scribus gives multiple error messages on trying to export, to the
effect that many objects are not on a page.
I have not tried to reproduce the error or work around it, but I have uploaded an .svg file:

https://bugs.scribus.net/view.php?id=15454
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: a.l.e on October 11, 2018, 08:21:42 AM
thanks for filling the ticket!
i've added a preview of what inkscape sees and exports as png...

let's hope that someone finds the issue...
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 11, 2018, 12:16:28 PM
In the issue tracker @utnik pinned down this issue ..

The discussion of "currentColor" in lilypond output SVG file is found in lilypond forum

http://lilypond.1069038.n5.nabble.com/rsvg-view-can-t-display-SVG-files-created-by-lilypond-tc191462.html#a191496

I have found that string "currentColor" is in one location in lilypond installation.
In my Ubuntu 16.04 it is here ..
/usr/share/lilypond/2.18.2/scm/output-svg.scm

The path will differ in Windows.

As a workaround, this file can be edited to change "currentColor" to "black" throughout.

I searched to find "what is an .scm file ?".

I found this ..

https://fileinfo.com/extension/scm (https://fileinfo.com/extension/scm)

QuoteWhat is an SCM file?

File Type 8
Schema File
Descriptor file that describes another document, such as an XML file; typically specifies the structure and formatting of the document as well as what type of data it can contain.

================================

[Later edit]

One option I explored before finding the above workaround was to pipe lilypond commandline SVG output through a filter to change "currentColor" to "black".

I read here that pandoc has a filter for lilypond.

https://github.com/jgm/pandocfilters

and here .. lilypond.py

https://github.com/jgm/pandocfilters/blob/master/examples/lilypond.py

I did not explore this idea further.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: a.l.e on October 11, 2018, 02:40:25 PM
the lillypond authors seem to know about the issue but (probably) wrongly decided to do nothing...

can somebody who uses lillypond try to post a bug report for this issue with jean's explanation from the bug tracker and telling them that this shortcut makes hard to import the svg in scribus?
(i mean, they could keep track of the color used and always set it explicitly, instead of relying on a default value that seems not to be 100% standardized)
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 11, 2018, 04:05:01 PM
Done. They are about to release a new version so hopefully it might be brought into line with Scribus SVG import.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on October 11, 2018, 05:08:03 PM
Re the .svg issue, well, I'm glad this didn't turn out to be totally just my cluelessness! Thanks DF & ALE for helping identify the issue.

On the other issue of the  .png resolution:
I tried putting this string into the lilypond command line in Atom-package lily-compile's settings:

-danti-alias-factor=10 -dresolution=300

where I had, before, had only

-dresolution=300

and got peculiar results including nothing happening,  a partial (?) error message, and making the VI program (Windows free image viewer I use) hang also, so that it displayed only a black screen even on other images, which went away after I closed and restarted it.

So this is why DF said,
"I think that you will need to install ImageMagick."
I may do this although I am not yet convinced of the necessity... (ahem, to be continued.)

When I tried the complete string (as given above by DF) directly in the Windows command line it took a very long time, and finally produced an error message, screen shot attached (for the record, although DF has been over this before.)

a search for "pngtopnm" turned up this page:

http://netpbm.sourceforge.net/doc/pngtopnm.html

with this text:
"...
This program is part of Netpbm.

pngtopnm was obsoleted by pngtopam, introduced with Netpbm 10.44 (September 2008). pngtopam is backward compatible with pngtopnm, plus adds many additional functions, including the ability to produce a PAM image that includes a transparency (alpha) channel. Starting in Release 10.48, pngtopnm is just an alias for pngtopam.

pngtopnm remained in the Netpbm package through Release 10.47 because it may have fewer bugs than pngtopam in those releases, and may be faster in some environments. But pngtopnm's incompatibility with the most current PNG libraries makes it impractical to maintain along with pngtopam now.

In releases before 10.48, you can use the pngtopam documentation for pngtopnm, considering the following differences:

    pngtopnm options are a subset of pngtopam's, as documented above.
    Any change that the pngtopam manual says happened in or after Netpbm 10.44 doesn't apply to pngtopnm.

..."

I also found this by searching "pngtopnm windows"

http://gnuwin32.sourceforge.net/packages/pngutils.htm

"PngUtils is a collection of utilities for PNG images: "

list of files including:

"[bullet] PngtoPnm: convert a Portable Network Graphics file into a portable anymap "

This looked like a likely thing instead of Image-Magick...
So I downloaded it and installed it, with more peculiar results, to wit:
I ran the same string from the Windows 7 DOS command line.
Took a long time. Sorry I didn't screen-shot the output. Said something about "renaming file to file.old" and then said, "file exists".
In the output directory there were then two files where there was one before.
One file appeared to be that which I had made with lily-compile an hour before - same date, time, properties, size 191 kilobytes, 300 dpi.
The second file had the same name with extension .png.old, and it is 4 megabtyes !! I took the .old extension off it, and indeed it appears to be a very high res .png file, but of course much too large to be of practical use. I can see part of it with VI, but it won't go small enough to see the whole thing! I tried to open it with Gimp, and Gimp appears to have hung - awaiting developments, it is still sitting there with its little hourglass. I'll give it a while.

Anyway, that's two strikes and one hit: the .svg and the anti-aliased .png have miss-fired, and the hi-res 300 dpi .png output from lilypond is working fine, and can be imported into Scribus routinely, and that's where it makes sense to me to leave it for now. Until I make a test print I have no further criticism of the 191k 300 dpi file, unless it turns out that it doesn't print well (and I could I suppose up the resolution more), but I have no printer these days, ha! So it can wait.

[attachment deleted by admin]
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 11, 2018, 06:09:11 PM
Searching the lilypond forum (which might be more informative for researching such errors) I read here
http://lilypond.1069038.n5.nabble.com/Spaces-in-filenames-don-t-work-with-danti-alias-factor-option-td72186.html
that this error occurs with spaces in filenames.

Does this message occur with a simple file name like test.ly? No underscores.
I saw no error messages in my test run.

It may not like underscores in filenames (I'm surmising).

Incidentally I don't think that ImageMagick is needed yet.

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on October 11, 2018, 06:14:18 PM
No, there are no spaces in the file name but there are under-scores.

After a while Gimp did open the big file and you may see a screen shot of the image properties attached.



[attachment deleted by admin]
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on October 11, 2018, 06:47:01 PM
OK, I took the underscores out of the file name and ran the command line string again, but it did not fix anything.

This time, "fatal error" message (see screen shot) and also, "pngtopnm is an unrecognized command" (neither of which happened the last time, sorry again I omitted to take a screen shot then), BUT the new output included a new .old file which is 4 megs, and also a .ps file - there was a .ps file output from the previous experiment also, which I hadn't noticed.

The .ps file could no doubt be converted.

This is all, I suppose, really in the province of the Lilypond developers. I have not yet joined the Lilypond mailing list - they have no forum - although I have searched the mailing list often lately. The bottom line here is the answer to the question "considering the current state of both open-source software programs, what Lilypond output works in Scribus now?" and we have one answer - the hi-res but not anti-aliased ,png file, as well as some interesting information. There does not appear to be any problem with Scribus. All of the problems have been generated by Lilypond. We have wandered far off the original topic of the footnotes, with unexpected but very interesting results, and the discussion has been very helpful and has certainly given me some useful new tools to work with.

Perhaps ImageMagick has amongst its utilities a different program also called pngtopnm, which would give different results from the GNU program that I found and installed, if invoked by Lilypond.   

[attachment deleted by admin]
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on October 11, 2018, 06:51:51 PM
I overlooked that I could scroll up in the command line window and find the previous command string run, so here is a screen shot of both processes for comparison.

[attachment deleted by admin]
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on October 11, 2018, 06:55:48 PM
Quote from: dragonfly on October 11, 2018, 06:09:11 PM
I saw no error messages in my test run.

so your test run used the pngtopnm from ImageMagick?
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 11, 2018, 07:11:39 PM
No .. I did not use ImageMagick .. that was a guess.

I did run this command in Ubuntu ...

pngtopnm --version
pngtopnm: Using libpbm from Netpbm Version: Netpbm 10.0
pngtopnm: BSD defined
pngtopnm: RGB_ENV='RGBDEF'
pngtopnm: RGBENV= 'RGBDEF' (env vbl is unset)

Check if you have pngtopnm library installed in Windows.

http://www.libpng.org/pub/png/apps/pnmtopng.html

Incidentaaly one of your reports shows file size 3.5 GB. This is very large.
I would focus on compiling smaller files into png and then concatenate the result.
Remember the discussion about merging fragments of markdown?

Lily-book might be worth exploring.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on October 11, 2018, 07:22:33 PM
That 3.5 gig file size comes from Lilypond's attempt to process my .ly  source file which is only about 4 kilobytes.
I didn't make an  .ly file that big! And without the anti-aliasing command it exports to a .png at 191 kilobytes, no problem. The huge files are all artifacts of the process generated by the extra command:

-danti-alias-factor=10

I though that the GNU program I installed a little while ago had included pngtopnm, but running

pngtopnm --version

from the command line gives me the error message, "not a recognized command"... my goof some way, I will look at this some more. The program is on my computer and installed, see screenshot. I also put its directory in the path, but still get "unrecognized command" from the command line.

I have been considering Lily-book, it does appear to be Lilypond's own in-house way to do what Scribus does, but as I am still dealing with basic input code in Lilypond, it will probably be a while before I am ready to tackle it.

[attachment deleted by admin]
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 11, 2018, 08:04:03 PM
Found this post ...

http://lilypond.1069038.n5.nabble.com/pngtopnm-missing-tc40933.html

Also reading backgrounds from this site ..

http://www.libpng.org/pub/png/apps/pnmtopng.html
and here ..
http://www.acme.com/software/pbmplus/
and here ..
http://www.schaik.com/png/pnmtopng.html

pnmtopng is a Unix library and there are some binaries for Windows.

===================

and more from Lilypond forum.

http://lilypond.1069038.n5.nabble.com/pngtopnm-missing-tc40933.html

QuoteI'm sorry I still can't answer your exact question, but I can give some pointers.  pngtopnm is a standard image file format converter on unix boxes, and so I guess Lily assumes it's there for some of its operations, and it isn't on Windows.  Hence the error message.

In my experiments, using --png with -dresolution=nnn gives exactly the same output as -dresolution=nnn/3 -danti-alias-factor=3 - so it appears not worth using the anti alias factor at all.  Accepting that you will never get an image file as good looking as PDF, since PDF scales, then something like lilypond --png -dresolution=900 should give you a better image than you need.

Thus this explains why I can run error free (in Unix) but you cannot (in Windows).  Try dropping -danti-alias-factor entirely.  And finally have you tried importing pdf into Scribus?

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: a.l.e on October 15, 2018, 10:02:04 AM
the scribus way of importing of svg has been modified in a way that it should work ok for the most common cases:

https://bugs.scribus.net/view.php?id=15454

the lillypond project should still explicitly set the background color.

depending on your platform, you can get the newest snapshot and get the import to work correctly!
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 16, 2018, 11:55:37 AM
Some progress here on svg compatibility on the LilyPond side ...

https://sourceforge.net/p/testlilyissues/issues/5429/ (https://sourceforge.net/p/testlilyissues/issues/5429/)

Importing svg from LilyPond might give cleaner images than importing png.
Certainly svg can be further edited/tweaked in Inkscape.

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on October 17, 2018, 05:08:48 PM
(a)
Quote from: dragonfly: "Thus this explains why I can run error free (in Unix) but you cannot (in Windows).  Try dropping -danti-alias-factor entirely."
OK, I am glad to set that to rest. Not necessary to use anti-alias factor or mess with invoking pngtopnm on Windows. Another random-rat-maze learning experience: there is nothing down that hole.

(b)
Quote from: dragonfly: "And finally have you tried importing pdf into Scribus?"
DF quoting from someone on the Lilypond mailing list: 
Quote from: unknown"Accepting that you will never get an image file as good looking as PDF, since PDF scales, then something like lilypond --png -dresolution=900 should give you a better image than you need."
No, I have not yet tried importing .pdf into Scribus.
I had naively assumed that .pdf was not intended for any use other than public document distribution, and I was completely unaware that "you will never get an image file as good looking as PDF" (since many of the pdf's I read are scans of fairly marginal quality and that is what I am used to) and so, I hadn't considered it.

I will re-evaluate this of course. But the only presenting reason for importing .pdf into Scribus, at the moment, is that .pdf might give better results with the export of Lilypond content than .png. The proof is a simple matter of exporting identical content from Lilypond in both formats and printing a page containing both; I'll get to it (ahh, it's inconvenient because I got fed up with the frequent planned obsolescence of consumer printers and ink cartridges, and don't keep one, so I have to go out.) But as the Lilypond list poster said, it should easily be possible to increase the .png resolution to the point where any difference is imperceptible. 300 dpi seems adequate, 600 dpi would be overkill ? and 900 more so.

By the way, I had an email exchange with the guy who wrote Lily-compile, who says that he had never intended for Lily-compile to do finished output (which he himself does from the command line) but that he intended it only for instant code checking from within Atom in the process of writing Lilypond code. However, given that Lily-compile can accept any command string that could be used on the command line, I don't see the benefit of this position, and I don't see any difference in the output.

(c)
Quote from: dragonfly: "Importing svg from LilyPond might give cleaner images than importing png"
I have had this in mind all along as a possibility and assumed it when I started in with Lilypond a month ago, but now having done a number of draft prints from my Scribus files, including one from my local pro printer who didn't complain about the image quality, I don't see that anything is lacking in the .png files that I have been using to date. (It could be that I don't know what the print standard really should be and that my printer was just humoring me. But the image quality has not been an issue with my draft prints. )

The "might give cleaner images" is not very compelling now that I have hi-res .png files available, particularly if I have to get into tweaking the .svg code for every file, adding an extra step. What _would_ be a reason for using .svg, is if there is some graphical result that I cannot figure out how to accomplish with Lilypond code, such that I would want to open the file in Inkscape and push the GROBs around or add some more elements. I can imagine this as a likely scenario, but the Lilypond docs assure me that Lilypond has every possible tweak built in, and so far I have found code snippets to do everything I have needed.

The bottom line for me is that a bird in the hand is worth two in the bush, so if I have something that works well enough, I am happy. If I determine that one thing works and another doesn't, I am inclined to go with what works now and not wrestle for too long with the problem of why the other thing doesn't work, because for me, such quests have so often ended in a morass because of my lack of technical knowledge. I do, however, very much appreciate the work of those who are capable and motivated to wrestle with those problems, because otherwise all of this open-source software would not exist. Thanks!

Dragonfly, when do you think that you may have a version of the Markdown-to-Scribus pipeline ready to test?
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 17, 2018, 10:07:56 PM
@jack_cat

It appears that you now have your act together. I understand your philosophy to stick with something that works. "a bird in the hand is worth two in the bush".

Regarding importing pdf objects into Scribus renderframes I am referring to advice I read in this Scribus forum.
But if you have high quality png objects then continue down that path.

Regarding Lily-compile, as I have written earlier, that is a simple wrapper using a single lilypond command.  If you require to change the command you have to go into Settings.

I have found in my experiments that installing the Atom package scripts offers more flexibility as you learn how to leverage lilypond commands.

apm install scripts

Basically you create a folder named (say) lilypond/commands and in there build a library of one liner bash scripts drawn from lilypond command line documents.

Here is a simple example of one bash script (Ubuntu notation):

#!/bin/bash

filename="$HOME/Atom-repo/music-experiment/example.ly"
lilypond --png -dresolution=300 $filename


Then in atom you can navigate to that library, select and highlight a script in tree-view, select Packages > Script > Run Script.

This has the same effect as Lilypond > Compile.  The difference is that you can create a large library of lilypond (and lily-book) commands without the need to dive into Settings each time.

On the subject of svg you write ...

QuoteWhat _would_ be a reason for using .svg, is if there is some graphical result that I cannot figure out how to accomplish with Lilypond code, such that I would want to open the file in Inkscape and push the GROBs around or add some more elements.

In fact svg comes into its own if you wanted to animate or scale the musical notations much as I showed in earlier links to websites with continuous scrolling.

However you are today focussed on static printing and this advantage of using svg objects does not apply to your project of writing a book.

Finally on my task to create a pipeline from markdown to Scribus document model at least I do now see the way forward.  However I am juggling several tasks and I cannot set a fixed date to rely on. Not too far ahead I hope.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on October 23, 2018, 09:34:48 PM
Dragonfly: Now I am really off topic but please indulge me: This is a question about copying, pasting, and auto-indentation in Atom.

While editing a lilypond file in Atom, it is very convenient (per the recommendations from lily users) to write one measure at a time and run lily-compile to check the output before going further (as it is really easy to screw up and then have difficulty finding the error). To make this easy, I copy and paste the code from an entire previous measure, 3 or 4 lines usually, and then edit that, rather than re-typing.

Atom has some kind of auto-indent feature which confuses me. SOMETIMES when I copy and paste such a code block, it indents it the same as the block above. OTHER times, it re-indents the whole block and thus the pasted blocks wander farther and farther toward the right side of the window unless I then delete all of the extra tabs and spaces at the beginning of the lines.

What don't I understand about this feature?
Thanks...

Re: using scripts in Atom: running Lilypond from a command line script:
this is a good idea and thank you, I will try it when I am ready for it...!

right now the stage that I am at w/ Lilypond, is that I type a few measures,stumble onto a new tool or technique that I will need to be able to use, (today, placing a "suggested accidental" above the staff and then pushing it around so that it looks better), and then spend an hour or two looking through the docs for the necessary code snippet and trying to understand it, and then type a few more measures.... I am devoting one day a week, more or less, using whatever musical excuse comes up for trying some new Lilypond techniques. I think it is going very well.

jack
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 23, 2018, 11:12:27 PM
QuoteTo make this easy, I copy and paste the code from an entire previous measure, 3 or 4 lines usually, and then edit that, rather than re-typing.

You might find the Atom "snippets" feature to be useful. There are two types of snippets.cson files.

One is global, found by Edit > Snippets and is the default core package installed .
Another is local (to each project) and requires the package "modular-snippets" to be installed. The local snippets.cson file is then located at the root of each project.

You can then build a snippets library of lilypond scripts you want to paste. You will need to learn how to use this feature. Basically in snippets.cson you write some alias which refers to the block of music notation.  To use the snippet you go to the start of a line, type the shortcode alias, then tab. this pastes the snippet into the editor.

QuoteAtom has some kind of auto-indent feature which confuses me. SOMETIMES when I copy and paste such a code block, it indents it the same as the block above. OTHER times, it re-indents the whole block and thus the pasted blocks wander farther and farther toward the right side of the window unless I then delete all of the extra tabs and spaces at the beginning of the lines.

What don't I understand about this feature?

Start by selecting the pasted code and then applying .. Edit > Lines > Autodent to see if that fixes the rogue indents.
There are two further features:
Edit > Lines > Indent
Edit > Lines > Outdent

this tip was found here ...

https://www.sitepoint.com/12-favorite-atom-tips-and-shortcuts-to-improve-your-workflow/

under Auto Indent.
"One annoyance I have is when I copy code from somewhere and the indentation is all over the place. Luckily, Atom has you covered. Select the code and head to Edit > Lines > Auto Indent."

There might be another cause but try this first.

Quote... and then spend an hour or two looking through the docs for the necessary code snippet and trying to understand it.
.

Surely we can improve on this turnaround time for research. 
I would start by copying the entirety of lilypond repository (snippets) and doc (separate downloads) into a local folder in Atom repo to avoid hopping to and fro between Atom editor and documents.

The repository of snippets is here.

http://lilypond.org/snippets.html

http://lsr.di.unimi.it/download/

http://lsr.di.unimi.it/download/lsr-snippets-all-2018-10-23.tar.gz

I will try out one or two tools I use for searching local repositories.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 24, 2018, 12:13:04 PM
Re: unwanted indent of pasted text in Atom ...

After further study of Settings ...

Open Settings Panel (Edit > Preferences)

Open the Editor settings panel link (just below Core link at top)

In there are these settings ..

Auto Indent                  .. default is enabled
Auto Indent on Paste     .. default is enabled

Try unticking Auto Indent on Paste.

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on October 24, 2018, 03:22:33 PM
Thanks! Working on all this...
jack
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 25, 2018, 05:13:30 PM
This tip follows on from my earlier suggestion that to improve on search performance you download and analyse the lilypond snippets repository.

We will attempt to leverage open source semantic analysis tools to work with Atom and Scribus.

Assuming that you have downloaded the lilypond snippets repository.

Proceed to this website ...

http://www.laurenceanthony.net/software.html

and download AntConc to match your local system.

There are other companion tools but AntConc should be sufficient for music notation.

Launch AntConc and the first requirement is in Global Settings > Files
and set Default file type to ALL then hit Apply button.

This ensures that lilypond files ending in *.ly will be analysed with other file types.

Now we navigate to AntConc File > Open Dir ...

I had downloaded and placed the Lilypond repository here ..

$HOME/Music/lsr-snippets-all-2018-10-23

and I select this target directory in AntConc.

This shows in left panel ... Total Number 3439 (the number of ALL files in the lilypond snippets repository).

Starting with field in Search Term - words

type some search term such as "bass" and hit Start.

After the search is completed browse through the tab views ..

Concordance | Concordance Plot | File View | Cluster NGrams | Collocates | Word Count | Keyword List

You may have to hit "Start" again as you switch tab views.

A useful tab view is Concordance.

e.g. type in search field some music term such as "bass" and click on any "bass" keyword coloured in blue.

This takes you to File View tab to preview the location where the keyword is located.

The file location is given at top of window.

Another useful view is Concordance Plot which shows where the term appears in each file.

Hopefully this concordance tool will improve your productivity.
I hope that it is not too technical.

These concordance analysis tools can be used to analyse any content and not just music notation. For example an author of any publication might wish to scan through a several hundred page book to search for terms.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on October 29, 2018, 09:26:38 PM
http://lsr.di.unimi.it/
the lilypond snippet repository URL is "server not found" - for now.

Downloaded Ant Conc, looks interesting, crashed when I opened the help file, had to close it w/ Windows Task Mgr.
I'll try the LP snippet rep again tomorrow.
thanks-
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 29, 2018, 09:55:00 PM
The lsr server does indeed seem to be busy.

Regarding concordance tool here is another one to try.

http://neon.niederlandistik.fu-berlin.de/en/textstat/

This one allows url's to be specified in building a corpus (AntConc does not offer that feature). So you could scrape pages in the lilypond web site.

I installed TextSTAT-3-beta (python3 usage) and ran the command

python3 TextSTAT.py to launch.

P.S. regarding AntConc crash there are two windows types to choose from when downloading. Did you match the correct software to your PC? 32bit or 64bit?
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on October 30, 2018, 11:00:13 AM
It does appear from this old thread ..  http://lilypond.1069038.n5.nabble.com/Lilypond-Snippet-Repository-td160345.html (http://lilypond.1069038.n5.nabble.com/Lilypond-Snippet-Repository-td160345.html) .. that the University of Milan lsr server does go off line on occasions.

QuoteThe web page at http://lsr.di.unimi.it/LSR/Search might be temporarily down or it may have moved permanently to a new web address.

I tried pinging it today.

ping lsr.di.unimi.it
PING sliver.docenti.di.unimi.it (159.149.136.4) 56(84) bytes of data.


So the options appear to be:

(a) raise a question at lilypond site on server status
or
(b) switch to online (url) queries for corpus building using TextSTAT.

I guess I was just lucky to earlier download the snippets repository to experiment with AntConc.

TextSTAT is a useful concordance tool. Since it is python based it might be a better choice to integrate (later) into Scribus pipeline.

Incidentally the conclusion I arrived at on Markdown>Scribus pipeline prototype was that the Atom markdown > Scribus pipeline requires an intermediary standard and as far as I see it should be epub2/epub3.

Thus the envisaged pipeline chain I'm working on will be ..

Atom (or other pre-authoring framework) Markdown > Markdown Preview Enhanced / Pandoc > Epub export > Scribus Epub import > printed AND/OR online publications

Ironically I have read that there has been earlier discussion on exporting epub from Scribus and I see that there is Scribus work in progress on that.  With the above envisaged chain, epub is created before hitting Scribus.  The epub style emulates the required Scribus document layout.  However Scribus does offer advanced layout features such as text flow around polygons and vectors and some compromise will be needed.

Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on November 14, 2018, 02:32:11 PM
Thanks for the update on the Scribus pipeline.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: jack_cat on December 06, 2018, 09:24:14 PM
An update on my current workaround with the end-note issue which started this thread:
Still working w/ version 1.4.6 (ha, going to have to upgrade someday...)

I am working in an 8.5 x 11" format with wide margins, and I have taken to putting the entire end-note texts into text boxes in teeny type in the margins next to the end-noted passage in the draft .sla file for each chapter. When I send the file to a draft .pdf, the notes are handy to their sources. When the draft is finished it will be easier to collect them all and put them in another .sla file together, than it would be if I had kept them in a separate file, and to fix all of the numbers at the same time while they are still side-by-side in the same file, and not have to go back and forth between windows. Until that point, it does not matter whether the numbering is correct, as long as I keep the marginal note and the noted text on the same page. I could easily do same-page footnotes with this same process, but I don't want the clutter on the page, so I still intend to use end-notes. This is not as streamlined as it might be, but it is an improvement over what I was doing before. Understand, I am still composing directly in Scribus in spite of all advice not to.
Title: Re: Suggestion: a good start for footnotes Insert > Char > Footnote#
Post by: dragonfly on December 07, 2018, 02:21:46 PM
You can also place notes in your current workflow into a separate layer.
You can then preview pages with and without the notes layer enabled.