US9418355B2: Crowdsourced Responses Management To Cases
In plain language
Efficient Response Management System and Method for Crowdsourced Networks
Addressing the reliability challenge in crowdsourced network with an innovative response management system. Ensure trust in responses with credentialing and compliance.
Drawings












12 sheets as filed; open one to see it at full size. A figure drawn across its sheet is turned to read upright.
What the drawings show
- The features of the disclosed embodiments may become apparent from the following detailed description taken in conjunction with the accompanying drawings showing illustrative embodiments herein, in which:
- FIG. 1 illustrates an example of an ecosystem to allow management of responses to cases submitted by an entity in a crowdsourced network according to an embodiment herein;
- FIG. 2 illustrates an example of a server in accordance with an embodiment herein;
- FIG. 3 illustrates an example of a processing circuit 204 in accordance with an embodiment herein;
- FIG. 4 illustrates generally, but not by the way of limitation, among other things, an exemplary operating environment for crowdsourced credentialing of respondents;
- FIG. 5 illustrates a credentialing system in accordance with an embodiment herein;
- FIG. 6 illustrates a credentialing system in accordance with another embodiment herein;
- FIG. 7 illustrates a response scoring module in accordance with an exemplary embodiment herein;
- FIG. 8 illustrates a method flowchart for management of responses to cases submitted by a plurality of entities in a crowdsourced network in accordance with an embodiment herein;
- FIGS. 9A and 9B illustrate user searchable interfaces to access various cases and responses in accordance with an embodiment herein; and
- FIG. 10 illustrates generally, but not by the way of limitation, a computer system that may be used in accordance with the embodiments herein.
Abstract
A response management system and method configured to allow management of responses to a case submitted by an entity in a crowdsourced network. The system includes a processing circuit that receives, from the entity over the crowdsourced network, the case. The processing circuit federates the case, into a plurality of federated cases, based on one or more parameters. The processing circuit routes the federated cases to the crowd of respondents in the network. The processing circuit receives responses from the crowd for each of the federated cases. The processing circuit integrates responses for each of the federated cases to yield a single integrated response for the case. The processing circuit publishes the integrated response anonymously that is viewable publicly.
The problem it addresses
1. Technical Field
The embodiments herein generally relate to management of responses online, and in particularly to systems and methods for management of responses created by a crowd of respondents in a crowdsourced network to increase authenticity of the responses.
2. Description of the Related Art
There exist online platforms through which individuals can submit their questions and a networked agency connected to the online platform provides answers to such questions. However, such answers are not very useful because of a lack of reliability and correctness of the answers.
The rest of the background
Therefore, there is a need for a method and system that ensures reliability and correctness of the answers by using wisdom of crowd and credentialing processes.
Summary of the invention
An embodiment herein provides a response management system configured to allow management of responses to a case submitted by an entity in a crowdsourced network. The system includes a memory for storing information pertaining to the case submitted by the entity, respective responses for the case by a crowd of respondents in the crowdsourced network, and programmed instructions. The system further includes a processing circuit. The processing circuit receives, from the entity over the crowdsourced network, the case. The processing circuit federates the case, into a plurality of federated cases, based on one or more parameters including a level of complexity, technology involved, and a level of reliability and trust desired in its respective response. Each of the federated cases are associated with one or more corresponding session parameters that are indicative of a respective level of complexity, technology involved, a level of reliability and trust in response desired. The processing circuit routes the federated cases to the crowd of respondents in the network such that the routing of the federated cases is managed based on the session parameters associated with each of the federated cases. The processing circuit receives responses from the crowd for each of the federated cases. The processing circuit associates information pertaining to the responses as second session parameters that are compared with the first session parameters such that the comparison yields a degree of compliance and appropriateness of the second session parameters toward the first session parameters. In response to a degree of compliance below a threshold for one or more federated cases, an adjusted set of third session parameters are associated with the one or more such federated cases. The processing circuit routes the one or more such non-compliant federated cases to a second crowd of respondents in the network such that the routing of the cases is managed based on the third session parameters associated with each of the one or more federated cases. The processing circuit integrates responses for each of the federated cases to yield a single integrated response for the case. The processing circuit publishes the integrated response anonymously that is viewable publicly.
An embodiment herein provides a method for management of responses to cases submitted by an entity in a crowdsourced network. The method includes receiving, from the entity over the crowdsourced network, a case. The method includes federating the case, into a plurality of federated cases, based on one or more parameters including a level of complexity, technology involved, and a level of reliability and trust desired in its respective response, wherein each of the federated cases are associated with one or more corresponding session parameters that are indicative of a respective level of complexity, technology involved, a level of reliability and trust in response desired. The method includes routing the federated cases to the crowd of respondents in the network such that the routing of the cases is managed based on the session parameters associated with each of the federated cases. The method includes receiving responses from the crowd for each of the federated cases. The method includes associating information pertaining to the responses as second session parameters that is compared with the first session parameters such that the comparison yields a degree of compliance and appropriateness of the second session parameters toward the first session parameters. In response to a degree of compliance below a threshold for one or more federated cases, an adjusted set of third session parameters are associated with the one or more such federated cases. The method includes routing the one or more such non-compliant federated cases to a second crowd of respondents in the network such that the routing of the cases is managed based on the third session parameters associated with each of the one or more federated cases. The method includes integrating responses for each of the federated cases to yield a single integrated response for the case corresponding to the federated cases. The method includes publishing the integrated response anonymously that is viewable publicly.
An embodiment herein provides a program storage device readable by a computer, and comprising a program of instructions executable by said computer to perform a method for management of responses to cases submitted by an entity in a crowdsourced network. The method includes receiving, from the entity over the crowdsourced network, a case. The method includes federating the case, into a plurality of federated cases, based on one or more parameters including a level of complexity, technology involved, and a level of reliability and trust desired in its respective response, wherein each of the federated cases are associated with one or more corresponding session parameters that are indicative of a respective level of complexity, technology involved, a level of reliability and trust in response desired. The method includes routing the federated cases to the crowd of respondents in the network such that the routing of the cases is managed based on the session parameters associated with each of the federated cases. The method includes receiving responses from the crowd for each of the federated cases. The method includes associating information pertaining to the responses as second session parameters that is compared with the first session parameters such that the comparison yields a degree of compliance and appropriateness of the second session parameters toward the first session parameters. In response to a degree of compliance below a threshold for one or more federated cases, an adjusted set of third session parameters are associated with the one or more such federated cases. The method includes routing the one or more such non-compliant federated cases to a second crowd of respondents in the network such that the routing of the cases is managed based on the third session parameters associated with each of the one or more federated cases. The method includes integrating responses for each of the federated cases to yield a single integrated response for the case corresponding to the federated cases. The method includes publishing the integrated response anonymously that is viewable publicly.
Independent claims
Claim 1
A response management system configured to allow management of responses to a case submitted by an entity in a crowdsourced network, said system comprising: a memory for storing information pertaining to said case submitted by said entity, respective responses for said case by a crowd of respondents in said crowdsourced network, and programmed instructions; a processing circuit configured to: receive, from said entity over said crowdsourced network, said case; federate said case, into a plurality of federated cases, based on one or more parameters including a level of complexity, technology involved, and a level of reliability and trust desired in its respective response, wherein each of said federated cases are associated with one or more corresponding session parameters that are indicative of a respective level of complexity, technology involved, a level of reliability and trust in response desired, and wherein said level of reliability and trust is controlled by using a crowdsourcing index (CI) that is indicative of a crowd of respondents; route said federated cases to said crowd of respondents in said network such that said routing of said federated cases is managed based on said session parameters associated with each of said federated cases; receive responses from said crowd for each of said federated cases; associate information pertaining to said responses as second session parameters that is compared with said first session parameters such that said comparison yields a degree of compliance and appropriateness of said second session parameters toward said first session parameters, wherein, in response to a degree of compliance below a threshold for one or more federated cases, an adjusted set of third session parameters are associated with said one or more such federated cases; route said one or more such non-compliant federated cases to a second crowd of respondents in said network such that said routing of said cases is managed based on said third session parameters associated with each of said one or more federated cases; integrate responses for each of said federated cases to yield a single integrated response for said case; and publish said integrated response anonymously that is viewable publicly, wherein said processing circuit further comprises a complexity evaluation engine to evaluate a complexity of various portions of said case prior to federating said case into said federated cases based on said level of complexity of said portions, and wherein said complexity evaluation engine evaluates a complexity of said various portions of said case based on inputs from a plurality of crowdsourced persons; and a scoring and reviewing module to review and associate a score to said integrated response by crowdsourced experts such that said integrated response when published bears a rating indicative of said experts review and score.
Claim 9
A method for management of responses to cases submitted by an entity in a crowdsourced network, said method comprising: receiving, from said entity over said crowdsourced network, a case; evaluating a complexity of various portions of said case based on said level of complexity of said portions; evaluating a complexity of said various portions of said case based on inputs from a plurality of crowdsourced persons; federating said case, into a plurality of federated cases, based on one or more parameters including a level of complexity, technology involved, and a level of reliability and trust desired in its respective response, wherein each of said federated cases are associated with one or more corresponding session parameters that are indicative of a respective level of complexity, technology involved, a level of reliability and trust in response desired; defining a crowdsourcing index (CI) that is indicative of a crowd of respondents, wherein said CI is defined based on desired reliability and trust in said integrated response; routing said federated cases to said crowd of respondents in said network such that said routing of said cases is managed based on said session parameters associated with each of said federated cases; receiving responses from said crowd for each of said federated cases; associating information pertaining to said responses as second session parameters that is compared with said first session parameters such that said comparison yields a degree of compliance and appropriateness of said second session parameters toward said first session parameters, wherein, in response to a degree of compliance below a threshold for one or more federated cases, an adjusted set of third session parameters are associated with said one or more such federated cases; routing said one or more such non-compliant federated cases to a second crowd of respondents in said network such that said routing of said cases is managed based on said third session parameters associated with each of said one or more federated cases; integrating responses for each of said federated cases to yield a single integrated response for said case corresponding to said federated cases; reviewing said single integrated response and associating a score to said single integrated response by crowdsourced experts such that said single integrated response when published bears a rating indicative of said experts review and score; and publishing said integrated response anonymously that is viewable publicly.
Claim 14
A non-transitory program storage device readable by a computer, and comprising a program of instructions executable by said computer to perform a method for management of responses to cases submitted by an entity in a crowdsourced network, said method comprising: receiving, from said entity over said crowdsourced network, a case; evaluating a complexity of various portions of said case based on said level of complexity of said portions; evaluating a complexity of said various portions of said case based on inputs from a plurality of crowdsourced persons; federating said case, into a plurality of federated cases, based on one or more parameters including a level of complexity, technology involved, and a level of reliability and trust desired in its respective response, wherein each of said federated cases are associated with one or more corresponding session parameters that are indicative of a respective level of complexity, technology involved, a level of reliability and trust in response desired; defining a crowdsourcing index (CI) that is indicative of a crowd of respondents, wherein said CI is defined based on desired reliability and trust in said integrated response; routing said federated cases to said crowd of respondents in said network such that said routing of said cases is managed based on said session parameters associated with each of said federated cases; receiving responses from said crowd for each of said federated cases; associating information pertaining to said responses as second session parameters that is compared with said first session parameters such that said comparison yields a degree of compliance and appropriateness of said second session parameters toward said first session parameters, wherein, in response to a degree of compliance below a threshold for one or more federated cases, an adjusted set of third session parameters are associated with said one or more such federated cases; routing said one or more such non-compliant federated cases to a second crowd of respondents in said network such that said routing of said cases is managed based on said third session parameters associated with each of said one or more federated cases; integrating responses for each of said federated cases to yield a single integrated response for said case corresponding to said federated cases; reviewing said single integrated response and associating a score to said single integrated response by crowdsourced experts such that said single integrated response when published bears a rating indicative of said experts review and score; and publishing said integrated response anonymously that is viewable publicly.
All 14 claims
- A response management system configured to allow management of responses to a case submitted by an entity in a crowdsourced network, said system comprising: a memory for storing information pertaining to said case submitted by said entity, respective responses for said case by a crowd of respondents in said crowdsourced network, and programmed instructions; a processing circuit configured to: receive, from said entity over said crowdsourced network, said case; federate said case, into a plurality of federated cases, based on one or more parameters including a level of complexity, technology involved, and a level of reliability and trust desired in its respective response, wherein each of said federated cases are associated with one or more corresponding session parameters that are indicative of a respective level of complexity, technology involved, a level of reliability and trust in response desired, and wherein said level of reliability and trust is controlled by using a crowdsourcing index (CI) that is indicative of a crowd of respondents; route said federated cases to said crowd of respondents in said network such that said routing of said federated cases is managed based on said session parameters associated with each of said federated cases; receive responses from said crowd for each of said federated cases; associate information pertaining to said responses as second session parameters that is compared with said first session parameters such that said comparison yields a degree of compliance and appropriateness of said second session parameters toward said first session parameters, wherein, in response to a degree of compliance below a threshold for one or more federated cases, an adjusted set of third session parameters are associated with said one or more such federated cases; route said one or more such non-compliant federated cases to a second crowd of respondents in said network such that said routing of said cases is managed based on said third session parameters associated with each of said one or more federated cases; integrate responses for each of said federated cases to yield a single integrated response for said case; and publish said integrated response anonymously that is viewable publicly, wherein said processing circuit further comprises a complexity evaluation engine to evaluate a complexity of various portions of said case prior to federating said case into said federated cases based on said level of complexity of said portions, and wherein said complexity evaluation engine evaluates a complexity of said various portions of said case based on inputs from a plurality of crowdsourced persons; and a scoring and reviewing module to review and associate a score to said integrated response by crowdsourced experts such that said integrated response when published bears a rating indicative of said experts review and score.
- The system of claim 1 , wherein said processing circuit comprises a federation engine that federates said case into said plurality of federated cases based on said one or more parameters including said level of complexity, technology involved, and said level of reliability and trust.
- The system of claim 1 , wherein said processing circuit further comprises a session parameters mapping engine that is configured to: compare said first session parameters with said second session parameters; compare said second session parameters with said third session parameters; and generate a correlationship map between each of said first session parameters and said second session parameters, and said second session parameters and said third session parameters, wherein said correlationship map is indicative of said compliance.
- The system of claim 1 , wherein said processing circuit further comprises a session parameter adjustment engine to determine said adjusted third session parameters based on a comparison of said second session parameters with said first session parameters in view of said threshold level.
- The system of claim 1 , wherein said processing circuit further comprises an integration engine to integrate said responses for said federated cases corresponding to said case.
- The system of claim 1 , wherein said processing circuit further comprises a credentialing engine to assess credentialed expertise of said respondents, wherein said credentialed expertise in indicative of credibility of responses submitted by said respondents.
- The system of claim 6 , wherein said credentialed expertise for each of said respondents allows classification of said respondents into distinct groups, with each group tagged with a trust-relationship identifier indicative of a trust and reliability that each group guarantees based on respective credentialed expertise.
- The system of claim 7 , wherein said trust-relationship identifier is further associated with an information pertaining to a relevant domain expertise such that said trust and reliability indicated by said trust-relationship identifier is guaranteed only in association with said relevant domain expertise.
- A method for management of responses to cases submitted by an entity in a crowdsourced network, said method comprising: receiving, from said entity over said crowdsourced network, a case; evaluating a complexity of various portions of said case based on said level of complexity of said portions; evaluating a complexity of said various portions of said case based on inputs from a plurality of crowdsourced persons; federating said case, into a plurality of federated cases, based on one or more parameters including a level of complexity, technology involved, and a level of reliability and trust desired in its respective response, wherein each of said federated cases are associated with one or more corresponding session parameters that are indicative of a respective level of complexity, technology involved, a level of reliability and trust in response desired; defining a crowdsourcing index (CI) that is indicative of a crowd of respondents, wherein said CI is defined based on desired reliability and trust in said integrated response; routing said federated cases to said crowd of respondents in said network such that said routing of said cases is managed based on said session parameters associated with each of said federated cases; receiving responses from said crowd for each of said federated cases; associating information pertaining to said responses as second session parameters that is compared with said first session parameters such that said comparison yields a degree of compliance and appropriateness of said second session parameters toward said first session parameters, wherein, in response to a degree of compliance below a threshold for one or more federated cases, an adjusted set of third session parameters are associated with said one or more such federated cases; routing said one or more such non-compliant federated cases to a second crowd of respondents in said network such that said routing of said cases is managed based on said third session parameters associated with each of said one or more federated cases; integrating responses for each of said federated cases to yield a single integrated response for said case corresponding to said federated cases; reviewing said single integrated response and associating a score to said single integrated response by crowdsourced experts such that said single integrated response when published bears a rating indicative of said experts review and score; and publishing said integrated response anonymously that is viewable publicly.
- The method of claim 9 , further comprising: comparing said first session parameters with said second session parameters; comparing said second session parameters with said third session parameters; and generating a correlationship map between each of said first session parameters and said second session parameters, and said second session parameters and said third session parameters, wherein said correlationship map is indicative of said compliance.
- The method of claim 9 , further comprising determining said adjusted third session parameters based on a comparison of said second session parameters with said first session parameters in view of said threshold level.
- The method of claim 9 , further comprising assessing credentialed expertise of said respondents, wherein said credentialed expertise is indicative of credibility of responses submitted by said respondents.
- The method of claim 9 , wherein said scoring and reviewing utilizes a crowdsourcing index (CI) that is indicative of a crowd of experts involved in review and scoring such that said CI and a response rating based on review and scoring bear a non-linear relationship with one another.
- A non-transitory program storage device readable by a computer, and comprising a program of instructions executable by said computer to perform a method for management of responses to cases submitted by an entity in a crowdsourced network, said method comprising: receiving, from said entity over said crowdsourced network, a case; evaluating a complexity of various portions of said case based on said level of complexity of said portions; evaluating a complexity of said various portions of said case based on inputs from a plurality of crowdsourced persons; federating said case, into a plurality of federated cases, based on one or more parameters including a level of complexity, technology involved, and a level of reliability and trust desired in its respective response, wherein each of said federated cases are associated with one or more corresponding session parameters that are indicative of a respective level of complexity, technology involved, a level of reliability and trust in response desired; defining a crowdsourcing index (CI) that is indicative of a crowd of respondents, wherein said CI is defined based on desired reliability and trust in said integrated response; routing said federated cases to said crowd of respondents in said network such that said routing of said cases is managed based on said session parameters associated with each of said federated cases; receiving responses from said crowd for each of said federated cases; associating information pertaining to said responses as second session parameters that is compared with said first session parameters such that said comparison yields a degree of compliance and appropriateness of said second session parameters toward said first session parameters, wherein, in response to a degree of compliance below a threshold for one or more federated cases, an adjusted set of third session parameters are associated with said one or more such federated cases; routing said one or more such non-compliant federated cases to a second crowd of respondents in said network such that said routing of said cases is managed based on said third session parameters associated with each of said one or more federated cases; integrating responses for each of said federated cases to yield a single integrated response for said case corresponding to said federated cases; reviewing said single integrated response and associating a score to said single integrated response by crowdsourced experts such that said single integrated response when published bears a rating indicative of said experts review and score; and publishing said integrated response anonymously that is viewable publicly.
Explained in plain language and in context
Patent summaries
- Efficient Response Management System and Method for Crowdsourced Networks
Addressing the reliability challenge in crowdsourced network with an innovative response management system. Ensure trust in responses with credentialing and compliance.
Licence or acquire US9418355B2
Available for an exclusive or non-exclusive licence, field-of-use licences included, or for acquisition. Terms on inquiry. Ask about the whole family or any one of its patents.
Or write to hello+ip@intellectualfrontiers.com. A person answers.
Questions
Is US9418355B2 available for licensing?
Yes. Intellectual Frontiers offers US9418355B2, with the rest of the Crowdsourced Responses Management To Cases family, for an exclusive or non-exclusive licence, field-of-use licences included. Terms are agreed on inquiry: write to hello+ip@intellectualfrontiers.com.
Can US9418355B2 be bought?
Yes. US9418355B2 is available for acquisition, alone or with its family. Terms are agreed on inquiry: write to hello+ip@intellectualfrontiers.com.
What is the status of US9418355B2?
Patented Case as of 27 July 2016, according to the USPTO record read 27 September 2026.
When does US9418355B2 expire?
14 April 2035. An estimate from Google Patents, read 9 October 2026. Fees, terminal disclaimers and later events can change it, and it is not legal advice.
What does US9418355B2 cover?
A response management system and method configured to allow management of responses to a case submitted by an entity in a crowdsourced network. The system includes a processing circuit that receives, from the entity over the crowdsourced network, the case. The processing circuit federates the case, into a plurality of federated cases, based on one or more parameters. The processing circuit routes A plain-language summary is at https://www.intellectualfrontiers.com/patent-summaries/efficient-response-management-system-and-method-for-crowdsourced-networks.
Who invented US9418355B2 and who holds it?
Shahid N. Shah is the inventor. Intellectual Frontiers LLC holds the rights.