Coevolving Innovations

… in Business Organizations and Information Technologies

Currently Viewing Posts in psychology

What Can Systems Thinkers Learn From an Evaluation Mindset? | Cameron D. Norman + Tara Campbell | Systems Thinking Ontario 2024-02-12

At the 118th meeting of Systems Thinking Ontario in February 2024, behavioral scientist Cameron D. Norman and design strategist Tara Campbell were invitied for a conversation guided by Zaid Khan.  The panelists are both alumni of the Strategic Foresight and Innovation program at OCADU.  Some time ago, they had conducted a research project on evaluation together, so this event was an opportunity for them to catch up at a relaxed pace.

As usual, participants had a round of self-introductions.   The panelists were guided through a conversation in three parts with focus questions, and participants were invited to offer their reflections and insights.  One linkage to modes of systems thinking was the distinction in approach by interest, e.g. Principles-Focused Evaluation, c.f. Developmental Evaluation.

This recording of the session is available on Youtube, as well as on the Internet Archive .

Video H.264 MP4
February 12
(1h53m)
[20240212_ST-ON_EvaluationMindset CameronDNorman_TaraCampbell.m4v
(1920×1080 1333kbps 1.16GB)
[on the Internet Archive]

A standalone audio was also created during the meeting.

Audio
February 12
(1h53m)
[20240212_ST-ON_EvaluationMindset CameronDNorman_TaraCampbell.m4a]
(126kbps, 103 MB)
[on the Internet Archive]

The gist of the description is below, with pre-readings linked on the original abstract.


— begin excerpt —

Systems thinkers often seek to affect systems through their ideas and actions, but how do we know we’ve made a difference? How might we measure what matters in ways that respect the various dynamics at play in often complicated and complex systems?… Read more (in a new tab)

At the 118th meeting of Systems Thinking Ontario in February 2024, behavioral scientist Cameron D. Norman and design strategist Tara Campbell were invitied for a conversation guided by Zaid Khan.  The panelists are both alumni of the Strategic Foresight and Innovation program at OCADU.  Some time ago, they had conducted a research project on evaluation together, so this event was an opportunity for them to catch up at a relaxed pace.

As usual, participants had a round of self-introductions.   The panelists were guided through a conversation in three parts with focus questions, and participants were invited to offer their reflections and insights.  One linkage to modes of systems thinking was the distinction in approach by interest, e.g. Principles-Focused Evaluation, c.f. Developmental Evaluation.

This recording of the session is available on Youtube, as well as on the Internet Archive .

Video H.264 MP4
February 12
(1h53m)
[20240212_ST-ON_EvaluationMindset CameronDNorman_TaraCampbell.m4v
(1920×1080 1333kbps 1.16GB)
[on the Internet Archive]

A standalone audio was also created during the meeting.

Audio
February 12
(1h53m)
[20240212_ST-ON_EvaluationMindset CameronDNorman_TaraCampbell.m4a]
(126kbps, 103 MB)
[on the Internet Archive]

The gist of the description is below, with pre-readings linked on the original abstract.


— begin excerpt —

Systems thinkers often seek to affect systems through their ideas and actions, but how do we know we’ve made a difference? How might we measure what matters in ways that respect the various dynamics at play in often complicated and complex systems?… Read more (in a new tab)

Sensemaking and Theory-Building | Gary S. Metcalf | ST-ON 2023-02-13

The theme for the February online meeting of Systems Thinking Ontario was sparked from the discussion from the January session on Root Metaphor and World Hypotheses.  What does it mean to have a theory?  How does sensemaking contribute to this?

Gary Metcalf volunteered to guide a conversation on these topics.  Two prereadings were to serve as an orientation for the diligent:

A smaller group convened for this discussion, enabling full participation by each and every attendee.  After a quick round of introductions , the conversation started around 4m20s in.

This recording of the session is available on Youtube, as well as on the Internet Archive .

Video H.264 MP4
February 13
(1h42m)
[20230213_ST-ON_Metcalf SensemakingTheoryBuilding.m4v]
(QHD 2560×1440 265kbps 289MB)
[on the Internet Archive]

A standalone audio was also created during the meeting.

Audio
February 13
(1h42m)
[20230213_ST-ON_Metcalf SensemakingTheoryBuilding.m4a]
(94.2MB)

The conversation flowed naturally.  I commented that before Gary was a professor of organizational systems, he had a prior career in family therapy.

Here is the original abstract sent in advance.


Some ideas have become everyday words.… Read more (in a new tab)

The theme for the February online meeting of Systems Thinking Ontario was sparked from the discussion from the January session on Root Metaphor and World Hypotheses.  What does it mean to have a theory?  How does sensemaking contribute to this?

Gary Metcalf volunteered to guide a conversation on these topics.  Two prereadings were to serve as an orientation for the diligent:

A smaller group convened for this discussion, enabling full participation by each and every attendee.  After a quick round of introductions , the conversation started around 4m20s in.

This recording of the session is available on Youtube, as well as on the Internet Archive .

Video H.264 MP4
February 13
(1h42m)
[20230213_ST-ON_Metcalf SensemakingTheoryBuilding.m4v]
(QHD 2560×1440 265kbps 289MB)
[on the Internet Archive]

A standalone audio was also created during the meeting.

Audio
February 13
(1h42m)
[20230213_ST-ON_Metcalf SensemakingTheoryBuilding.m4a]
(94.2MB)

The conversation flowed naturally.  I commented that before Gary was a professor of organizational systems, he had a prior career in family therapy.

Here is the original abstract sent in advance.


Some ideas have become everyday words.… Read more (in a new tab)

Being a scholar-practitioner, humble inquiry, human and non-human systems

With recent invitations to mentor graduate students, I’ve had to more strongly assert my identity as a scholar-practitioner.  It’s now been over 10 years since I “graduated” from a career at IBM of 28 years.  University students are often amused to discover that, besides having spent a lot of time around universities, I first entered a Ph.D. program in 1982.  When I met my future spouse, I was a doctoral student.  Many years later, I’m still a doctoral student.

My colleagues in the Systems Changes Learning Circle have surfaced an interest in humility.  This reminds me that in spring 1982, I met with Edgar Schein in his office at the MIT Sloan School of Management.  (In the end, I was #2 on a list of 1 for admission into the doctoral program on information systems research, so my life took a different path).

The ties from organization development back into systems theory surfaced in a 2021 interview with Ed Schein.

— begin transcript of Rainey and Schein (2021) —

[35:30 Chris Rainey] Ed, I’ve seen you speak quite a few times, now, about diagnosis versus intervention. Could you share more of your thoughts on this, because I found it very interesting.

[35:42 Ed Schein] Well, I think, the thing that we haven’t yet come to terms with, is a phrase that important philosopher by the name of [Sir Geoffrey] Vickers stated, is the human systems are different.… Read more (in a new tab)

With recent invitations to mentor graduate students, I’ve had to more strongly assert my identity as a scholar-practitioner.  It’s now been over 10 years since I “graduated” from a career at IBM of 28 years.  University students are often amused to discover that, besides having spent a lot of time around universities, I first entered a Ph.D. program in 1982.  When I met my future spouse, I was a doctoral student.  Many years later, I’m still a doctoral student.

My colleagues in the Systems Changes Learning Circle have surfaced an interest in humility.  This reminds me that in spring 1982, I met with Edgar Schein in his office at the MIT Sloan School of Management.  (In the end, I was #2 on a list of 1 for admission into the doctoral program on information systems research, so my life took a different path).

The ties from organization development back into systems theory surfaced in a 2021 interview with Ed Schein.

— begin transcript of Rainey and Schein (2021) —

[35:30 Chris Rainey] Ed, I’ve seen you speak quite a few times, now, about diagnosis versus intervention. Could you share more of your thoughts on this, because I found it very interesting.

[35:42 Ed Schein] Well, I think, the thing that we haven’t yet come to terms with, is a phrase that important philosopher by the name of [Sir Geoffrey] Vickers stated, is the human systems are different.… Read more (in a new tab)

Schizophrenia, Alcoholism, Double Binds: From Practice to System Theory | Gary S. Metcalf | ST-ON 2021-02-21

Many might sequence systems thinking as (i) systems theory preceding (ii) systems practice.  This is not always the case.  There are situations where (i) systems practice has preceded (ii) systems theory, or the two advance in a tight learning loop.  Jack Ring once pointed out that applied science (engineering) precedes science, because human beings often have systems working before we understand why they work.

Gregory Bateson was consulting on questions associated with schizophrenia and communications, that expanded into a broader theory of double binds.  Along the way, he developed an appreciation for techniques amongst alcoholics where the twelve steps of Alcoholics Anonymous were leading to a more correct epistemology.

Before pursuing studies in systems sciences, Gary Metcalf was in practice with an earlier career in family therapy.  He explained how techniques and frameworks that he had previously applied became enriched with the deeper understanding of systems thinking, and a history of science associated with the double bind.

This video has been archived on the Internet Archive .

Video H.264 MP4
February 21
(1h37m)
[20220221_ST-ON_Metcalf_SchizophreniaAlcoholismDoubleBinds_WQHD.m4v]
(WQHD 1042kbps 818MB)
[on the Internet Archive]

Audio downloadable onto mobile devices was transcoded from the video into MP3.

Audio
February 21
(1h37m)
[20220221_ST-ON_Metcalf_SchizophreniaAlcoholismDoubleBinds.mp3]
(33.8MB)

Gary provided some slides to guide the discussion.

Here is the original Systems Thinking Ontario session description.

Is there a pattern where you see a system is stuck? In the 1960s-1970s, anthropologist Gregory Bateson was working with cases of schizophrenia and alcoholism, leading to the development of systems theories on double-binds.… Read more (in a new tab)

Many might sequence systems thinking as (i) systems theory preceding (ii) systems practice.  This is not always the case.  There are situations where (i) systems practice has preceded (ii) systems theory, or the two advance in a tight learning loop.  Jack Ring once pointed out that applied science (engineering) precedes science, because human beings often have systems working before we understand why they work.

Gregory Bateson was consulting on questions associated with schizophrenia and communications, that expanded into a broader theory of double binds.  Along the way, he developed an appreciation for techniques amongst alcoholics where the twelve steps of Alcoholics Anonymous were leading to a more correct epistemology.

Before pursuing studies in systems sciences, Gary Metcalf was in practice with an earlier career in family therapy.  He explained how techniques and frameworks that he had previously applied became enriched with the deeper understanding of systems thinking, and a history of science associated with the double bind.

This video has been archived on the Internet Archive .

Video H.264 MP4
February 21
(1h37m)
[20220221_ST-ON_Metcalf_SchizophreniaAlcoholismDoubleBinds_WQHD.m4v]
(WQHD 1042kbps 818MB)
[on the Internet Archive]

Audio downloadable onto mobile devices was transcoded from the video into MP3.

Audio
February 21
(1h37m)
[20220221_ST-ON_Metcalf_SchizophreniaAlcoholismDoubleBinds.mp3]
(33.8MB)

Gary provided some slides to guide the discussion.

Here is the original Systems Thinking Ontario session description.

Is there a pattern where you see a system is stuck? In the 1960s-1970s, anthropologist Gregory Bateson was working with cases of schizophrenia and alcoholism, leading to the development of systems theories on double-binds.… Read more (in a new tab)

Humanistic Principles and Social Systems Design | Douglas Austrom + Carolyn Ordowich (ST-ON 2021-05-10)

Douglas Austrom and Carolyn Ordowich shared some reflections developed jointly with Bert Painter (Vancouver, BC) on some draft humanistic principles, the three Tavistock perspectives, and a meta-methodology with Systems Thinking Ontario.

Proponents of Socio-Technical Systems design refer back to the 1960s-1980s research of Fred Emery and Eric Trist of the Tavistock Institute. Calls to reinvent approaches to organization design for hyper-turbulent environments may be better viewed through the whole systems view of three perspective for sensemaking:

  • social-psychological systems;
  • socio-technical systems; and
  • socio-ecological systems.

Those who live and work in a given social system should be given the voice and and choice in designing their system. Calvin Pava’s notion of deliberation design applies not only to non-linear knowledge work. It can serve as a meta-methodology for dialogic design of organizations, networks and ecosystems. The role of designers shifts from designing the social system itself, to co-designing the deliberations by which key stakeholders can dynamically design their own systems.

This video has been archived on the Internet Archive .

Video H.264 MP4
May 10
(1h50m)
[20210510_ST-ON_HumanisticSocialSystemsDesign.m4v]
(FHD 1431kbps 1.2GB) [on the Internet Archive]

Audio downloadable onto mobile devices was transcoded from the video into MP3.

Audio
May 10
(1h50m)
[20210510_ST-ON_HumanisticSocialSystemsDesign.mp3]
(38MB) [on the Internet Archive]

Doug Austrom has four decades of consulting experience, having co-founded three change consultancies: Turning Point Associates, Adjutant Solutions Group, and People Powered Innovation Labs. He is an adjunct professor with Indiana University’s online MBA program, Kelly Direct.… Read more (in a new tab)

Douglas Austrom and Carolyn Ordowich shared some reflections developed jointly with Bert Painter (Vancouver, BC) on some draft humanistic principles, the three Tavistock perspectives, and a meta-methodology with Systems Thinking Ontario.

Proponents of Socio-Technical Systems design refer back to the 1960s-1980s research of Fred Emery and Eric Trist of the Tavistock Institute. Calls to reinvent approaches to organization design for hyper-turbulent environments may be better viewed through the whole systems view of three perspective for sensemaking:

  • social-psychological systems;
  • socio-technical systems; and
  • socio-ecological systems.

Those who live and work in a given social system should be given the voice and and choice in designing their system. Calvin Pava’s notion of deliberation design applies not only to non-linear knowledge work. It can serve as a meta-methodology for dialogic design of organizations, networks and ecosystems. The role of designers shifts from designing the social system itself, to co-designing the deliberations by which key stakeholders can dynamically design their own systems.

This video has been archived on the Internet Archive .

Video H.264 MP4
May 10
(1h50m)
[20210510_ST-ON_HumanisticSocialSystemsDesign.m4v]
(FHD 1431kbps 1.2GB) [on the Internet Archive]

Audio downloadable onto mobile devices was transcoded from the video into MP3.

Audio
May 10
(1h50m)
[20210510_ST-ON_HumanisticSocialSystemsDesign.mp3]
(38MB) [on the Internet Archive]

Doug Austrom has four decades of consulting experience, having co-founded three change consultancies: Turning Point Associates, Adjutant Solutions Group, and People Powered Innovation Labs. He is an adjunct professor with Indiana University’s online MBA program, Kelly Direct.… Read more (in a new tab)

Theoretical Grounds, Pragmatic Grounds: Methods for Reordering our Priorities through Systems Changes Learning (ST-ON 2020/10/19)

For the second of three workshops by the Systems Changes Learning Circle in October 2020, we convened a session for the monthly Systems Thinking Ontario meeting.  The focus of this workshop was a review of progress to date on methods by the scholarly team, informed by the adoption and use by the field team.

The framing of this presentation centered on developing methods that have validity balanced between theoretical grounds (i.e. it seems right based on logic and science) and pragmatic grounds (i.e. it works when applied in practice).

This workshop had more of a “teach-the-teachers” style to it, explaining the deeper choices in concepts, terms and techniques.  Compared to the other two workshops, this audience has a stronger grasp of systems theory.  Many regular attendees have attended meetings over the past 5 years.

In the web video , the presentation slides were mostly covered sequentially.  Attendees clarified their understandings with questions posed towards the end.

The video file are downloadable from the Internet Archive .

Video H.264 MP4
October 19
(1h57m)
[20201019_ST-ON_SystemsChanges.m4v]
(FHD 806kbps 790MB) [on the Internet Archive]

For those who like digital audio on-the-go, the session has been transcoded to MP3 .

Audio
October 19
(1h57m)
[20201019_ST-ON_SystemsChanges.mp3]
(44MB)

This session extended prior presentations on Systems Changes, with the benefit of the RSD9 version oriented towards designers having been completed just a few days earlier.  The freshness of that experience encouraged a reflections on ideas that had gone over over well fort the designers, as well as some examples and metaphors that may need to be rethought.… Read more (in a new tab)

For the second of three workshops by the Systems Changes Learning Circle in October 2020, we convened a session for the monthly Systems Thinking Ontario meeting.  The focus of this workshop was a review of progress to date on methods by the scholarly team, informed by the adoption and use by the field team.

The framing of this presentation centered on developing methods that have validity balanced between theoretical grounds (i.e. it seems right based on logic and science) and pragmatic grounds (i.e. it works when applied in practice).

This workshop had more of a “teach-the-teachers” style to it, explaining the deeper choices in concepts, terms and techniques.  Compared to the other two workshops, this audience has a stronger grasp of systems theory.  Many regular attendees have attended meetings over the past 5 years.

In the web video , the presentation slides were mostly covered sequentially.  Attendees clarified their understandings with questions posed towards the end.

The video file are downloadable from the Internet Archive .

Video H.264 MP4
October 19
(1h57m)
[20201019_ST-ON_SystemsChanges.m4v]
(FHD 806kbps 790MB) [on the Internet Archive]

For those who like digital audio on-the-go, the session has been transcoded to MP3 .

Audio
October 19
(1h57m)
[20201019_ST-ON_SystemsChanges.mp3]
(44MB)

This session extended prior presentations on Systems Changes, with the benefit of the RSD9 version oriented towards designers having been completed just a few days earlier.  The freshness of that experience encouraged a reflections on ideas that had gone over over well fort the designers, as well as some examples and metaphors that may need to be rethought.… Read more (in a new tab)

  • RSS qoto.org/@daviding (Mastodon)

    • daviding: “Diachrony (or diachronic shifts) resurrects a word from 1857…” April 10, 2024
      Diachrony (or diachronic shifts) resurrects a word from 1857, better expressing *changes through time*. A social practice publication in 1998 contrasts synchronic with diachronic. https://ingbrief.wordpress.com/2024/04/10/diachronic-diachrony/
    • daviding: “Web video introduction of 15 minutes for 1-hour Lunch and Le…” March 22, 2024
      Web video introduction of 15 minutes for 1-hour Lunch and Learn #CentreForSocialInnovationToronto on "Systems Changes Dialogues for Social Innovation" invites practitioners for upcoming monthly meetings. Evocative animated images, details deferred to conversations with mentors. https://coevolving.com/blogs/index.php/archive/systems-changes-dialogues-csi/#SystemsThinking
    • daviding: “Web video of slides from "From Unfreezing-Refreezing, to Sys…” March 21, 2024
      Web video of slides from "From Unfreezing-Refreezing, to Systems Changes Learning" for Dialogic Drinks of #EQLab represents only 1/5 of the time compared to peer-led discussions. Concise hosting called for brevity, and richer presentations. https://coevolving.com/blogs/index.php/archive/from-unfreezing-refreezing-eq-lab/ #SystemsThinking
    • daviding: “Hosting multiple Dialogic Drinks on "From Unfreezing-Refreez…” March 8, 2024
      Hosting multiple Dialogic Drinks on "From Unfreezing-Refreezing, to Systems Changes Learning" online, March 12 (Europe), March 14 (Americas), March 15 (Australia). #Leadership meets #SystemsThinking . Short presentations, longer discussions https://www.eqlab.co/from-unfreezing-refreezing-to-systems-changes-learning-david-ing
    • daviding: “"Climate change has no map that we know of. Each time a new…” February 15, 2024
      "Climate change has no map that we know of. Each time a new scientific study returns something we studied before, it's always going to arrive faster and be worse than we thought before". Episode 5, #DavidLHawk "What to do When It's too Late" https://www.youtube.com/watch?v=VPruvIsDRDk #SystemsThinking "Instead of cause-effect thinking, effects coming from prior effects, not […]
  • RSS on IngBrief

    • The Nature and Application of the Daodejing | Ames and Hall (2003)
      Ames and Hall (2003) provide some tips for those studyng the DaoDeJing.
    • Diachronic, diachrony
      Finding proper words to express system(s) change(s) can be a challenge. One alternative could be diachrony. The Oxford English dictionary provides two definitions for diachronic, the first one most generally related to time. (The second is linguistic method) diachronic ADJECTIVE Oxford English Dictionary, s.v. “diachronic (adj.), sense 1,” July 2023, https://doi.org/10.1093/OED/3691792233. For completeness, prochronic relates “to […]
    • Introduction, “Systems Thinking: Selected Readings, volume 2”, edited by F. E. Emery (1981)
      The selection of readings in the “Introduction” to Systems Thinking: Selected Readings, volume 2, Penguin (1981), edited by Fred E. Emery, reflects a turn from 1969 when a general systems theory was more fully entertained, towards an urgency towards changes in the world that were present in 1981. Systems thinking was again emphasized in contrast […]
    • Introduction, “Systems Thinking: Selected Readings”, edited by F. E. Emery (1969)
      In reviewing the original introduction for Systems Thinking: Selected Readings in the 1969 Penguin paperback, there’s a few threads that I only recognize, many years later. The tables of contents (disambiguating various editions) were previously listed as 1969, 1981 Emery, System Thinking: Selected Readings. — begin paste — Introduction In the selection of papers for this […]
    • Concerns with the way systems thinking is used in evaluation | Michael C. Jackson, OBE | 2023-02-27
      In a recording of the debate between Michael Quinn Patton and Michael C. Jackson on “Systems Concepts in Evaluation”, Patton referenced four concepts published in the “Principles for effective use of systems thinking in evaluation” (2018) by the Systems in Evaluation Topical Interest Group (SETIG) of the American Evaluation Society. The four concepts are: (i) […]
    • Quality Criteria for Action Research | Herr, Anderson (2015)
      How might the quality of an action research initiative be evaluated? — begin paste — We have linked our five validity criteria (outcome, process, democratic, catalytic, and dialogic) to the goals of action research. Most traditions of action research agree on the following goals: (a) the generation of new knowledge, (b) the achievement of action-oriented […]
  • Recent Posts

  • Archives

  • RSS on daviding.com

    • 2024/03 Moments March 2024
      More work than play for first part of month, in anticipation of trip to Vancouver to visit family.
    • 2024/02 Moments February 2024
      Chinese New Year celebrations, both public and family, extended over two weekends, due to busy social schedules.
    • 2024/01 Moments January 2024
      Hibernated with work for most of January, with more activity towards the end of month with warmer termperatures.
    • 2023/12 Moments December 2023
      A month of birthdays and family holiday events, with seasonal events at attractuions around town.
    • 2023/11 Moments November 2023
      Dayliight hours getting shorter encouraged more indoor events, unanticipated cracked furnace block led to replacement of air conditioner with heat pump, too.
    • 2023/10 Moments October 2023
      Left Seoul for 8 days in Ho Chi Minh City, and then 7 days in Taipei. Extended family time with sightseeing, almost completely offline from work.
  • RSS on Media Queue

    • What to Do When It’s Too Late | David L. Hawk | 2024
      David L. Hawk (American management theorist, architect, and systems scientist) has been hosting a weekly television show broadcast on Bold Brave Tv from the New York area on Wednesdays 6pm ET, remotely from his home in Iowa. Live, callers can join…Read more ›
    • 2021/06/17 Keekok Lee | Philosophy of Chinese Medicine 2
      Following the first day lecture on Philosophy of Chinese Medicine 1 for the Global University for Sustainability, Keekok Lee continued on a second day on some topics: * Anatomy as structure; physiology as function (and process); * Process ontology, and thing ontology; * Qi ju as qi-in-concentrating mode, and qi san as qi-in-dissipsating mode; and […]
    • 2021/06/16 Keekok Lee | Philosophy of Chinese Medicine 1
      The philosophy of science underlying Classical Chinese Medicine, in this lecture by Keekok Lee, provides insights into ways in which systems change may be approached, in a process ontology in contrast to the thing ontology underlying Western BioMedicine. Read more ›
    • 2021/02/02 To Understand This Era, You Need to Think in Systems | Zeynep Tufekci with Ezra Klein | New York Times
      In conversation, @zeynep with @ezraklein reveal authentic #SystemsThinking in (i) appreciating that “science” is constructed by human collectives, (ii) the west orients towards individual outcomes rather than population levels; and (iii) there’s an over-emphasis on problems of the moment, and…Read more ›
    • 2019/04/09 Art as a discipline of inquiry | Tim Ingold (web video)
      In the question-answer period after the lecture, #TimIngold proposes art as a discipline of inquiry, rather than ethnography. This refers to his thinking On Human Correspondence. — begin paste — [75m26s question] I am curious to know what art, or…Read more ›
    • 2019/10/16 | “Bubbles, Golden Ages, and Tech Revolutions” | Carlota Perez
      How might our society show value for the long term, over the short term? Could we think about taxation over time, asks @carlotaprzperez in an interview: 92% for 1 day; 80% within 1 month; 50%-60% tax for 1 year; zero tax for 10 years.Read more ›
  • Meta

  • Creative Commons License
    This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License
    Theme modified from DevDmBootstrap4 by Danny Machal