Uncategorized

AI, NL, NLP

Documents, audio recordings, videos, images – data is growing daily in the business world and most of it is unstructured, which makes it difficult for many organizations to extract insights and actionable information for improved business operations and smarter decision-making. These business issues are now changing with the rise of new AI technologies, machine learning and natural language processing in today’s search and analytics solutions. From e-commerce and customer service, to intranet portals and collaboration, business leaders hungry for greater automation and intelligence are finding opportunities to improve processes and better empower their workforce to drive transformative results.

AI, Machine Learning, Natural Language Processing can be complicated strategies to integrate into Enterprise systems. Give your unstructured data project a kick-start with a commercially proven and industry tested solution that brings AI, ML and NLP all under one hood and with a straight forward API – Doc-Tags / xAIgent!

We’re making Complex Data Driven Decisions a whole lot easier!
Investigate Doc-Tags Today  =  https://www.Doc-Tags.com/Developer

Advertisement

Enterprise Content Management – Context

Enterprise Content Management systems(ECM) or Intelligent Information Management systems (IIM) is the development of strategies, methods, and tools used to create, capture, automate, deliver, secure and analyse content and documents related to organizational process. There are a number of enterprise solution providers in this arena – AABBY, Documentum, Hewlett Packard, IBM, Laserfiche, Microsoft, Oracle to name a few. Each with their own perspective and collection of tools that make their solution the right one.

Organizational process revolves around structure and their supporting information including contracts, forms, agreements and the like, which for the most part are managed as structured information (collections of clauses, responses, form-based data…). How those structured data are acquired, imputed, processed and consumed is the foundation of the solutions offered by those mentioned above and others.

Another basic tenant of Enterprise Content Management is the employment of strategies for managing, categorizing and indexing unstructured content in support of the organizational processes. A common approach for giving unstructured content structure is to employ Tags. Meta Tags, keywords, Key Phrases – concise descriptions that can be added to the profile of the content such as Document Tagging, which enhances the contextual accuracy for searching and retrieving content when required.

When unstructured content, legal precedence for instance, is being logged into an Enterprise Content Management system, if the person tasked with logging the content is not the author and the document does not have author-provided Tags there are only a couple of options for giving that unstructured content any resemblance of structure. As long as the operator has security clearance to view the content, they can – i) read the document and define the tags that should be used; ii) use the document title, first paragraph or synopsis (if there is one) along with the file name to make a best efforts guess and select a generic category item from a pre-defined list of options already set in the system for categorizing content; or iii) use a phrase parsing strategy and referential library (Bayesian / Heuristic algorithms) to give the content some structure based on general, pre-defined subject matter terminology. The latter forms of content classification are okay, at least they provide some structure and a better chance that the content being managed can be retrieved with a little more accuracy.

These somewhat automated referential approaches rely upon pre-cast, narrow focus, subject specific referential libraries – that may or may not relate to the content being managed. For instance, medical malpractice is an entirely different subject matter from bio-tech patent law. Both dealing with legal and medical matters, however, the subject terminology of each are at different ends of the spectrum. This is a simple example of where a generic referential process really doesn’t work and to correct it what is needed are two specific referential libraries, each tailored to that branch of law. Not very efficient and expensive to produce.

What about a fourth option, where an understanding of the construct of human language is employed allowing for the target content to be parsed, in context of itself, to reveal a primary set of key phrases? In essence a process that strips away all of the conjugative words, the if’s, and’s, but’s…, to reveal a collection of content specific key phrases. And, that process compares how many times each key term is used throughout the document and the frequency of each relevant term given a ranking. The highest ranked terms are then used to retrieve the most predominant examples from the target content of that term’s use. A Key phrase / Keyword extracted summary if you will. Automatically, without training (no need for referential libraries), unsupervised, solely in context of the target content, accurately with pure subject relevance.

This fourth option is a patent-backed artificial intelligence and machine learning based approach available today. A content specific, key term extraction approach that relies upon patented Artificial Intelligence and machine learning technologies for deriving target document – accurate, contextual, relevant Tags. This strategy is baked into Doc-Tags™. The only solution available today providing document specific, contextually accurate, unsupervised process for Automatically giving a document or collection of documents their own file specific Tags.

Now, think of employing Doc-Tags™ in an Enterprise Content Management system where unstructured content can be given its own custom structure based upon relevant, contextual, accurate Tags. ECM content now stored, secured, analyised with the most accurate search and retrieval possible. Test Drive Context Today – Doc-Tags.com™.

Accurate, Contextual, Relevant – Unsupervised, Automatic Document Tagging – www.Doc-Tags.com™

Incredible Backward Compatibility…

First a little back ground…

Supply Chain Management (SCM), Field Service Management (FSM), Warehouse Management Systems (WMS), Enterprise Resource Planning (ERP), Customer Relationship Management (CRM), Manufacturing Resource Planning (MRP)… these and other similar types of enterprise systems all share a common theme of managing and optimizing ‘resources’.

Enterprise systems require flexibility, being able to view and strategically position Resources so that the Who’s doing What, Where, When and Why – can all be managed with intuitive Drag and Drop data presentations.  DBI’s data management and presentation component software – Solutions Schedule and Studio Controls have been the go-to standards for Enterprise Windows developers for 21 years.

Through the evolution of our award winning component products, DBI has worked diligently to maintain the integrity of our customer’s original investment in their development tools.

Case-In-Point:
Jonathan L. with a long time customer providing commercial Warehouse Management Systems in Europe, was setting up a new development system. In the course of building the new system he looked to activate an archive installation of Solutions Schedule .NET v1.0 (released in 2005) which was originally implemented in the development of their software. To say the least, much has transpired since the release of Solutions Schedule .NET v1.0 in 2005. Through the course of our conversation and a quick overview of the latest enhancements crafted into Solutions Schedule .NET 7.0, the current shipping and Windows 10 supported product – Jonathan downloaded the current evaluation license and tested it out on a copy of their solution.

In the copy of their application Jonathan changed the references from dbiScheduleE.dll version 1.0 to dbiScheduleE.dll version 7.0 and within an astonishing brief 20 minutes he was starting to implement new features in their application, without having to recode or rewrite any of the original code. Twelve years after their original purchase of Solutions Schedule .NET upgraded to the latest version and picked up without missing a beat!

In Jonathan’s own words…”I did a fast test and I was able to use Solutions Schedule .NET  v7.0 with only 20min of work. That is definitely incredible backward compatibility.” http://bit.ly/0916NB

Automatically Extract Contextually Accurate Keyphrases

Using advanced linguistic focused Artificial Intelligence and Machine Learning processes found in to the patented Extractor technology, the xAIgent RESTful web service provides subscribers with an effortless software service for automatically extracting contextually accurate keyphrases / key words / key terms – from any subject matter content.
The xAIgent RESTful service, uses the patented Extractor hybrid Artificial Intelligence and machine learning Linguistic Technology to provide subscribers with the most accurate and contextually relevant key terms from any subject domain text, automatically (unsupervised).
In contrast, it’s worthwhile to note there are other keyphrase extraction systems and most based on heuristic and Bayesian derived key word extraction models. Each inherently requiring their systems to be manually trained per each subject domain the developer / user wishes to employ.  Training is a process whereby a library (corpus) of pre-defined, domain specific content and keywords must first be compiled an then incorporated in to the comparative structure (supervised process) of that system.  Cumbersome at best. Tedious and time intensive expert knowledge required.
The xAIgent automatic keyphrase extraction RESTful web service is ready for consumption immediately, without further training, supporting English, French, German, Japanese, Korean and Spanish, and provides subscribers with the most accurate, contextually relevant keyphrases of any solution available today.
Where would an automatic, contextually accurate key word / keyphrase extraction RESTful service be useful?
Think of document management and content management systems, where their contents must first have key terms / key words assigned to each document prior to its inclusion in the repository. If the author has not previously tagged the content, then a subject matter expert must be employed to appropriately determine the key terms that describe the document. Read / Re-read the content, identify the key words, terms and phrases and then annotate to the document. Then the document / content can be included into the document management system.
To help alleviate the read / re-read document process, often document management systems will have a generic list of subject terms to select from and assign to the document. That may be all well and good if the documents being consumed are all of similar subject matter, but is that really the best approach? Wouldn’t it be better to have contextually accurate key terms per document that would then allow the true value of the documents being included into the management system to be exposed? Allowing them to b effectively accessed, searched, referenced and reported on.
Of course and the simple answer… subscribe to the xAIgent RESTful web service and have objective (human generated key words by their nature are subjective), contextually accurate key terms generated automatically. For all unstructured content. In other words, set your own xAIgent enhanced system to work through a collection of content folders and have each document automatically associated with its own set of key words / key terms / key phrases / tags – Automatically. Come back when the process is completed (over night) and start to fully realize the enhanced value that has now been surfaced for that collection of documents.
There are many other aspects of the xAIgent (Extractor) service to note and we’ll do that in subsequent editions, including why xAIgent is so good at retrieving key phrase content from websites and why research shows the automatic xAIgent (nee Extractor) key term extraction process carries an accuracy rating of up to 87 percent.

Visualizing Resource Management (1)

Visualizing Resource Management – the art, the science and the power to visually plan and position the right resources, in the right places, at the right times.  Sounds like a fairly straight forward concept and should be wrapped into every ERP, Logistics and CRM related software consumed by any organization.

And that’s where the opportunity presents itself – most enterprise systems do not employ visual resource planning and scheduling. The complexities of visually representing multi-dimensional resource scheduling data is challenging and very rewarding when you get it right.  There are two products that have stood the test of various industries for the last twenty years and have got it right, every time.

Of course these products didn’t start out as they are today – through the course of your enterprise management demands and coding challenges, Studio Controls and Solutions Schedule have been influenced and have evolved significantly over the course of the last twenty years. To where we are at this time – the strongest most feature rich, natural user interface design controls available – consumed by commercial software companies for myriad industries around the world.

Welcome to 2016!  The next step in the evolution of Visual Resource Management, Natural Language Processing and Text Analytics.  We have a number of exciting new developments to share with you in course of the next number of months.  First, we’re going to start with a number of product updates, then shortly after that a whole new multi-faceted scheduling control and then the world of how we search, divine and consume information changes.

Contextually accurate summary meaning from any text – “Point of View”

What were the salient points from Martin Luther Kings’ famous ‘I Have a Dream’ speech – remember? We remember what the demonstration was about and the impact of that day in history – that speech – what were the quotable quotes?

In today’s hyper world of ‘Now’ – how would you find these key phrases? This is a great example of where the xAIgent (ex-ai-gent) key phrase retrieval system (RESTful Service) shines: The speech – six pages in length, comprising 1667 words, organized in 44 paragraphs, 7458 characters – What were the top 30 key phrases from his ‘I Have A Dream’ speech?

Let’s find out…

xAIgent Service Sample Online Demonstration
xAIgent.com – xAIgent RESTful Service Sample – Online Demo

Objectively and accurately, how can we discern the top 30 key phrases from Martin Luther King Jr’s ‘I Have A Dream’ speech in today’s impatient world of ‘Now’?

Simple – xAIgent RESTful Service *1 = http://www.xAIgent.com, here’s what it looks like:

• A – copy the text of the speech
• B – paste the copied speech into the xAIgent Demo Application
• C – Set the Key Phrase selector dial to 30
• D – Plug in the captcha auth code
• E – Click the ‘Run the xAIgent’ button

And the five step process is simply this…

A – copy the text of the speech

xAIgent RESTful Service Sample - Online Demo - I have a dream - Martin Luther King Jr.

– paste the copied speech into the xAIgent Demo Application

xAIgent RESTful Service - Online Demo - I have a dream - Martin Luther King Jr.

C – Set the Key Phrase selector dial to 30

xAIgent RESTful Service - Online Demo - I have a dream, Martin Luther King Jr.

D – Plug in the captcha auth code

xAIgent RESTful Service - Online Demo - I have a dream, Martin Luther King

E – Click the ‘Run the xAIgent’ button

xAIgent RESTful Service - Online Demo Example - I have a Dream, Martin Luther King

In a matter of milliseconds the xAIgent RESTful service sends your request to DBI’s hosted service and returns to you the top 30 key phrases from Martin Luther King Jr’s famous ‘I Have A Dream’ speech including highlights from the body of the speech that demonstrates why each keyphrase is important (in this example). Here are the results in descending order of importance*:

1. FREEDOM
Score: 23.29412
Highlight: I am happy to join with you today in what will go down in history as the greatest demonstration for freedom in the history of our nation.

2. NEGRO
Score: 15.141178
Highlight: This momentous decree came as a great beacon light of hope to millions of Negro slaves who had been seared in the flames of withering injustice.

3. FREEDOM RING
Score: 12
Highlight: And so let freedom ring from the prodigious hilltops of New Hampshire.

4. NATION
Score: 11.64706
Highlight: I am happy to join with you today in what will go down in history as the greatest demonstration for freedom in the history of our nation.

5. DREAM
Score: 11
Highlight: And so even though we face the difficulties of today and tomorrow, I still have a dream.

6. AMERICA
Score: 10.482354
Highlight: It is obvious today that America has defaulted on this promissory note, insofar as her citizens of color are concerned.

7. JUSTICE
Score: 9.317648
Highlight: And so, we’ve come to cash this check, a check that will give us upon demand the riches of freedom and the security of justice.

8. SATISFY
Score: 9
Highlight: Let us not seek to satisfy our thirst for freedom by drinking from the cup of bitterness and hatred.

9. MOUNTAIN
Score: 7
Highlight: we will be able to hew out of the mountain of despair a stone of hope.

10. FAITH
Score: 5
Highlight: and this is the faith that I go back to the South with.

11. BROTHERHOOD
Score: 5
Highlight: I have a dream that one day on the red hills of Georgia, the sons of former slaves and the sons of former slave owners will be able to sit down together at the table of brotherhood.

12. PROMISSORY
Score: 4.658824
Highlight: When the architects of our republic wrote the magnificent words of the Constitution and the Declaration of Independence, they were signing a promissory note to which every American was to fall heir.

13. LAND
Score: 4.658824
Highlight: the Negro is still languished in the corners of American society and finds himself an exile in his own land.

14. MISSISSIPPI
Score: 4
Highlight: We cannot be satisfied as long as a Negro in Mississippi cannot vote and a Negro in New York believes he has nothing for which to vote.

15. RIGHTS
Score: 3.494118
Highlight: And there will be neither rest nor tranquility in America until the Negro is granted his citizenship rights.

16. PROMISSORY NOTE
Score: 3.494118
Highlight: When the architects of our republic wrote the magnificent words of the Constitution and the Declaration of Independence, they were signing a promissory note to which every American was to fall heir.

17. LIVES
Score: 3.494118
Highlight: the Negro lives on a lonely island of poverty in the midst of a vast ocean of material prosperity.

18. INJUSTICE
Score: 3.494118
Highlight: This momentous decree came as a great beacon light of hope to millions of Negro slaves who had been seared in the flames of withering injustice.

19. SLAVES
Score: 3.494118
Highlight: I have a dream that one day on the red hills of Georgia, the sons of former slaves and the sons of former slave owners will be able to sit down together at the table of brotherhood.

20. HILL
Score: 3
Highlight: Let freedom ring from every hill and molehill of Mississippi.

21. GEORGIA
Score: 3
Highlight: I have a dream that one day on the red hills of Georgia, the sons of former slaves and the sons of former slave owners will be able to sit down together at the table of brotherhood.

22. ALABAMA
Score: 3
Highlight: I have a dream that one day, down in Alabama, with its vicious racists, with its governor having his lips dripping with the words of “interposition” and “nullification” — one day right there in Alabama little black boys and black girls will be able to join hands with little white boys and white girls as sisters and brothers.

23. SWELTERING
Score: 3
Highlight: I have a dream that one day even the state of Mississippi, a state sweltering with the heat of injustice, sweltering with the heat of oppression, will be transformed into an oasis of freedom and justice.

24. VALLEY
Score: 3
Highlight: Now is the time to rise from the dark and desolate valley of segregation to the sunlit path of racial justice.

25. RISE
Score: 3
Highlight: Now is the time to rise from the dark and desolate valley of segregation to the sunlit path of racial justice.

26. TRANQUILIZING
Score: 2.329412
Highlight: This is no time to engage in the luxury of cooling off or to take the tranquilizing drug of gradualism.

27. URGENCY
Score: 2.329412
Highlight: We have also come to this hallowed spot to remind America of the fierce urgency of Now.

28. REFUSE
Score: 2.329412
Highlight: We refuse to believe that there are insufficient funds in the great vaults of opportunity of this nation.

29. INSUFFICIENT FUNDS
Score: 2.329412
Highlight: We refuse to believe that there are insufficient funds in the great vaults of opportunity of this nation.

30. CITIZENS
Score: 2.329412
Highlight: It is obvious today that America has defaulted on this promissory note, insofar as her citizens of color are concerned.

You will notice that key terms – Freedom and Nation are high in the ranking and draw emphasis from the same paragraph, however, in different context. The ability of xAIgent to discern Context, while accurately and objectively providing key term summary highlights is a unique characteristic of the xAIgent RESTful Service.

Also, ‘I have a dream’ is obviously a key element that appears later on in the speech and we see that relevance in the Key Phrases and their highlights – and how this theme is given contextual emphasis from different words used in the speech drawing specific attention.

This type of contextual accuracy is not possible using a referential-based system – to gain the currency of ‘Context’ along with objective accuracy – xAIgent is the only solution.

As a RESTful Service, xAIgent is very simple to implement in to a project – see how: Sample Setup Code

Subscribe to a full free developer evaluation here :: http://www.xAIgent.com – slide down to the 5th item in the list and click on the link.

xAIgent Today !

The Scarce Resource will be ‘Points of View’

“There will be more really great content too, but snagging it in an ocean of banal junk will be harder than ever.  It is this avalanche of content that will make context the scarce resource.”

The words of well known Futurist / Forecaster Paul Saffo.

And the conversation continues… context won’t really be the gold commodity of the time – “Point of view” will be.  ‘That quintessentially-human solution to information overload, an intuitive process of reducing things to an essential relevant and manageable minimum.’

Much like the 16th century proverb – ‘necessity is the mother of invention’, we are at a new point where technology can answer the current need – for context, and Point of View out of the growing ocean of content.  A solution with a narrowed focus, simplified implementation and the ability to quickly derive near perfect ‘Point of View’.

The necessity, the desire – distill content into contextually accurate ‘Points of View’ – in more common terms of this webified world  –  key phrases and keywords.  If only there were an easily consumable technology – a RESTful service for instance that answered the call.   There is – it’s called  xAIgent.

See how you can make your content relevant and manageable.    http://www.xAIgent.com

Strong Sector Growth From ERP, CRM… Software Companies

Do you keep half an eye on what’s happening in the global software market?  It’s interesting to note the strong sector growth for those segments that relate to the supply of goods and services and those that focus on ‘the relationship’ – and specifically the Customer Relationship Management. You’ve got it right, CRM, ERP, SCM, HMS / HIS, FSM and the like have all seen notable increases in growth worldwide this past year – ranging from 8% to 13% and the forecast from various industry analysts concur  continued growth will maintain at a similar pace through 2020.

It’s no surprise that many of the software companies serving these market segments are long time DBI customers. Where the Solutions Schedule and Studio Controls product lines offer unique solutions for what can be extremely complex programming requirements.

For those in the midst of challenging some of these complexities using creative scheduling and UI design concepts we offer one more tool for your toolbox – and may be surprisingly to some – an open source .NET Warehouse and Shipments Scheduling Framework. Navigate to CodePlex and look for the ‘Warehouse Scheduling Framework’ – https://dbischedulingframework.codeplex.com

Enterprise Resource Management Software Trends

Do you keep half an eye on what’s happening in the global software market?  It’s interesting to note the strong sector growth for those segments that relate to the supply of goods and services and those that focus on ‘the relationship’ – and specifically the Customer Relationship Management. You’ve got it right, CRM, ERP, SCM, HMS / HIS, FSM and the like have all seen notable increases in growth worldwide this past year – ranging from 8% to 13% and the forecast from various industry analysts concur  continued growth will maintain at a similar pace through 2020.

It’s no surprise that many of the software companies serving these market segments are long time DBI customers. Where the Solutions Schedule and Studio Controls product lines offer unique solutions for what can be extremely complex programming requirements.

For those in the midst of challenging some of these complexities using creative scheduling and UI design concepts DBI is now offering one more developer tool for the Visual Studio toolbox – which may come as a surprise for some – an open source .NET Warehouse and Shipments Scheduling Framework. Navigate to CodePlex and look for the ‘Warehouse Scheduling Framework’ – https://dbischedulingframework.codeplex.com

The Dynamics of Scheduling

Scheduling :     for many of us scheduling is a common term for referencing a period of time allocated for an activity. That allocation may be contrasted against a vertical time-line (ruler) as is common with day timers, Microsoft Outlook and other appointment book presentations. DBI represents this type of functionality in the calendar and appointment scheduling controls found in Studio Controls.

An alternate perspective in scheduling may be termed as Gantt-style, a common reference in project management, where a value of time (time bar) is associated with a resource in relation to a horizontal time line (ruler). Gantt includes a definition where the relation of activities on a time line (ruler) may be linked or have affect to other activities/ resources along the same time line. The concept of Gantt in terms of scheduling resources (assets) allows a quick reference of availability which may or may not be directly related to other entities. The ability at a high level to see what a list of resources are doing, when, where, how and why. DBI represents this type of Macro Scheduling application functionality in terms of  Solutions Schedule.

TERMINOLOGY

There are three distinct perspectives to the term scheduling; Appointment Scheduling, Multi-Resource / Asset Management Scheduling and Project management. Project management incorporates an element of timeline scheduling, however, its true value is in managing a collection of required resources to complete a series of tasks in direct relation to each other, over a proposed period of time. Appointment scheduling focuses on an individual entity or entities over a series of hours or days. What may be termed as micro scheduling. Multi-resource and asset management scheduling on the other hand focuses on a list of entities (typically a Y axis presentation) and their status along a fixed or varying time line (an X axis orientation) which may include other relational information captured by an associated time bar. The concept of macro scheduling may be termed in this context.

In many scheduling instances macro (resource) and micro (appointment) scheduling views are needed to give end-users the right tools at the right time and to correctly present and interact with time-based relational information. For an in-depth discussion with Visual Studio sample code navigate to… Case Study