Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)S

Sp1983

@ melezhik @programming.dev

Posts
14
Comments
35
Joined
3 yr. ago

  • DSCI - CI engine with programming languages to write pipelines (no YAML)

    Jump

  • But now when you have a YAML program as the first level abstraction how do you handle results between those multi language calls ? In DSCI this is achieved via states and normal functions , and everting is just a function on general purpose programming language, in YAML you need all these magic ( awkward ) YAML syntax to mimic all those things ( pass parameters , handle global variables , process user input , handle returned parameters , etc )

  • DSCI - CI engine with programming languages to write pipelines (no YAML)

    Jump

  • If you use tools gluing them into YAML - you get YAML bloated with time . When you say those tools already having Python - excellent I would like to use those Python libs or SDK directly in my Python code instead of juggling those tools as cli or code blocks inside YAML

    UPDATE: and yeah , re-read again - I guess the most of automation is done today via “CI” pipelines even when those are not meant to be CI only, like you said … anyways the rest I have said stands true for me … don’t bake your code into YAML )

  • DSCI - CI engine with programming languages to write pipelines (no YAML)

    Jump

  • The issues you had just proves that YAML based CI approach always leads to troubles with time. And yeah, I have been there, code generators for YAML. Hundreds of lines for YAML pipelines, etc ))

    It allows the CI engine to determine which jobs to start, what their steps are etc.

    Yep, like a said , I don't mind to have such a configuration inside YAML, but this should NOT be pipeline code itself )

  • DSCI - CI engine with programming languages to write pipelines (no YAML)

    Jump

  • ... put those in separate scripts and call them from the YAML.

    This is exactly what I try to avoid, cause:

    1. many people (in my experience ) even don't bother refactoring YAML spaghetti code to separate scripts and we end up unmaintainable codebase
    2. and even if one has to do such a refactoring what is the point of using YAML at all ?

    All I need just a collection of tasks/jobs written on languages of choice and I don't need YAML "programming" language at all )

    PS And btw I don't mind having a minimal amount of YAML as configuration layer and this is what is presented in DSCI, but only minimal ))

  • DSCI - CI engine with programming languages to write pipelines (no YAML)

    Jump

  • it's just because I think in real world we have a lot of tasks where state is required or extremely beneficial, some examples on top of my head:

    • creation of virtual machines with dynamic IP addresses
    • creation of bug tracking system tickets with unique ticket IDs
    • looking up in databases where fetched records have unique IDs

    etc

  • DSCI - CI engine with programming languages to write pipelines (no YAML)

    Jump

  • Ok, try to do it on GH actions, share states between tasks/jobs for example:

    tasks/task_one/task.py

     
        
#!/usr/bin/python3

update_state({
  'out1' : 'out1 value',
  'out2' : 'out2 value'
})

    tasks/task_two/task.py

     
        
#!/usr/bin/python3

dict = get_state()
print(dict["out1"])
print(dict["out2"])

    Or share states between jobs:

    jobs/job1/task.py

     
        
#!/usr/bin/python3

update_state({
  'out1' : 'out1 value',
  'out2' : 'out2 value'
})

    jobs/job2/task.py

     
        
#!/usr/bin/python3

dict = config()

print(dict["_dsci_"]["job1"]["out1"])
print(dict["_dsci_"]["job1"]["out2"])

    I can't imagine how much boilerplate code (if this ever possible ) one needs to write to achieve that on YAML based pipelines (GH Actions/ etc)

    And don't tell me about jobs artifacts ))

    UPDATE:

    Another good example is to run tasks conditionally, yes using old good if:

     
        
#!/usr/bin/python3

if some_condition(foo, bar): 
    run_task(
       'task1', {
          'foo' : 'foo value',
          'bar' : 'bar value'
       }
    )

    The same could be quite awkward in YAML based code

  • DSCI - CI engine with programming languages to write pipelines (no YAML)

    Jump

  • DSCI - CI engine with programming languages to write pipelines (no YAML)

    Jump

  • Here is SDK for those languages:

    Raku Perl Bash Python Ruby Powershell Php Golang

    UPDATE: so it's not just hitting up a language from a pipeline , it's full reach SDK, one writes a pipeline on a language, if I get your comment correctly

  • DSCI - CI engine with programming languages to write pipelines (no YAML)

    Jump
  • Programming @programming.dev
    Sp1983 @programming.dev

    DSCI - CI engine with programming languages to write pipelines (no YAML)

    dev.to /sp1983/dsci-ci-with-regular-programming-languages-instead-of-yaml-5h71

  • Hardening Rocky Linux with DTAP test protocol

    Jump
  • Linux @programming.dev
    Sp1983 @programming.dev

    Hardening Rocky Linux with DTAP test protocol

    dev.to /melezhik/hardening-rocky-linux-with-dtap-test-protocol-58pe

  • Sparrow plugin to run compliance checks on Linux infrastructure

    Jump

  • Typo )) sorry , meant password less

  • Sparrow plugin to run compliance checks on Linux infrastructure

    Jump

  • This seems, at best, some general security checks but not mapped to any framework in particular.

    So. Yes. Ssh access should be passwords only, etc. Some common sense. We don’t need standard to that

    UPDATE: sorry for the typo, meant passwordless

  • Linux @programming.dev
    Sp1983 @programming.dev

    Sparrow plugin to run compliance checks on Linux infrastructure

    dev.to /melezhik/linux-compliance-checks-with-sparrow-plugin-2160

  • Tool to check Linux services configuration files compliance

    Jump

  • Tool to check Linux services configuration files compliance

    Jump

  • I probably need to add report example here …

    Update - done in readme

  • Linux @programming.dev
    Sp1983 @programming.dev

    Tool to check Linux services configuration files compliance

  • Kill the Conditional Maze: From If-Statements to Rule Pipelines

    Jump

  • I guess cause not every AI stuff is a bad and annoying thing .

  • Kill the Conditional Maze: From If-Statements to Rule Pipelines

    Jump

  • Something started to happen to programming.dev see some posts with many downvotes but without any comments , so people don’t even bother to say what /why they don’t like , even in Reddit people usually comment even when they don’t like your posts and explain their point …

    Update : or maybe this is just a c/programming tendency …

  • Programming @programming.dev
    Sp1983 @programming.dev

    Plugins SDK for dead simple ci engine (yamless pipeline engine for gitea/forgejo)

    deadsimpleci.sparrowhub.io /doc/bash-plugins
  • Programming @programming.dev
    Sp1983 @programming.dev

    Dead Simple CI Introduction

    dev.to /melezhik/dead-simple-ci-introduction-1jh6

  • Dsci runner migrated to golang

    Jump
  • Programming @programming.dev
    Sp1983 @programming.dev

    Dsci runner migrated to golang

    deadsimpleci.sparrowhub.io /doc/forgejo-setup
  • Programming @programming.dev
    Sp1983 @programming.dev

    Dsci runner migrated to golang

    deadsimpleci.sparrowhub.io /doc/forgejo-setup

  • Dead Simple CI

    Jump

  • It uses yaml only for configuration part, but pipeline itself is far more then that . Not sure what do you mean by “middle ground”, could you please elaborate? Thanks

  • Dead Simple CI

    Jump

  • Just added the feature of running jobs on localhost for debugging:

    cd .dsci/job_one; docker run -it -v $PWD:/opt/job --entrypoint /bin/bash dsci -c "cd /opt/job/; s6 --task-run ."

  • Programming @programming.dev
    Sp1983 @programming.dev

    Dead Simple CI

    deadsimpleci.sparrowhub.io /doc/README
  • Programming @programming.dev
    Sp1983 @programming.dev

    Double TAP - Text and Test Anything Protocol

    doubletap.sparrowhub.io
  • Linux @programming.dev
    Sp1983 @programming.dev

    Harden sysctl.conf by Sparrow checks

    wp.me /p8gE3q-18N
  • Golang @programming.dev
    Sp1983 @programming.dev

    Useful terminal plugins to build golang code

    dev.to /melezhik/useful-terminal-plugins-to-build-golang-code-gj0
  • Programming @programming.dev
    Sp1983 @programming.dev

    SparrowHub - Raku Plugins for daily $work

    sparrowhub.io