References for: assertion
Full identifier: https://w3id.org/np/RAKmi8CK-UdWMP9L6Q9YymxVSFsIlM1cP-6WDc4T4ocN0#assertion
Nanopublication | Part | Subject | Predicate | Object | Published By | Published On |
---|---|---|---|---|---|---|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
|||
links a nanopublication to its provenance
http://www.nanopub.org/nschema#hasProvenance
provenance
|
assertion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
|||
links a nanopublication to its provenance
http://www.nanopub.org/nschema#hasProvenance
provenance
|
assertion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
|||
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
|||
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Evolver, model merging in a genetic algorithm
Improves on current merging techniques (my beloved TIES 🫣 )
Train diverse models
Merge regularly or take diff between two models
Update some parameters
Keep if good
Repeat
https://arxiv.org/abs/2406.12208
@jingli9111 @banting_liu @576gsk https://twitter.com/LChoshen/status/1803410440535326786/photo/1
Merging is aimed at taking many models and getting one that generalizes better, there are various methods for it, read more e.g. on TIES
https://x.com/prateeky2806/status/1665759148380758022
Genetic algorithms evolve models, in steps:
Create mutations (here new m = m_old + a(m_1-m_2)) m are models a some constant
Crossover, take some of the mutation and apply it, for each parameter randomly keep m_old or update to m_new
Survive, keep only the best performing on val
By sometimes merging and sometimes evolving (and dev sets) they improve over all current methods https://twitter.com/LChoshen/status/1803410445635653960/photo/1
In some sense, this can be seen as a better search in the region between the merged models, which we know is not equally good but all better than the edges
https://x.com/LChoshen/status/1729488495515713672 https://twitter.com/LChoshen/status/1803410447246250483/photo/1
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
||
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
TIES
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
||
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
evolver
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
||
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
genetic_algorithms
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
||
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
knowledge_fusion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
||
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
model_merging
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
||
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
|||
links a nanopublication to its provenance
http://www.nanopub.org/nschema#hasProvenance
provenance
|
assertion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
|||
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
|||
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
|||
links a nanopublication to its provenance
http://www.nanopub.org/nschema#hasProvenance
provenance
|
assertion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
|||
links a nanopublication to its provenance
http://www.nanopub.org/nschema#hasProvenance
provenance
|
assertion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|
|||
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Sensenets
|
2024-09-12T18:58:02.418Z
|